DeepAI AI Chat
Log In Sign Up

Panoptic Segmentation with a Joint Semantic and Instance Segmentation Network

by   Daan de Geus, et al.
TU Eindhoven

We present an end-to-end method for the task of panoptic segmentation. The method makes instance segmentation and semantic segmentation predictions in a single network, and combines these outputs using heuristics to create a single panoptic segmentation output. The architecture consists of a ResNet-50 feature extractor shared by the semantic segmentation and instance segmentation branch. For instance segmentation, a Mask R-CNN type of architecture is used, while the semantic segmentation branch is augmented with a Pyramid Pooling Module. Results for this method are submitted to the COCO and Mapillary Joint Recognition Challenge 2018. Our approach achieves a PQ score of 17.6 on the Mapillary Vistas validation set and 27.2 on the COCO test-dev set.


page 1

page 5


Panoptic Feature Pyramid Networks

The recently introduced panoptic segmentation task has renewed our commu...

Joint COCO and Mapillary Workshop at ICCV 2019: COCO Instance Segmentation Challenge Track

In this report, we present our object detection/instance segmentation sy...

Joint Learning of Instance and Semantic Segmentation for Robotic Pick-and-Place with Heavy Occlusions in Clutter

We present joint learning of instance and semantic segmentation for visi...

Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Images

In this paper, we focus on the challenging multicategory instance segmen...

UPSNet: A Unified Panoptic Segmentation Network

In this paper, we propose a unified panoptic segmentation network (UPSNe...

Single Network Panoptic Segmentation for Street Scene Understanding

In this work, we propose a single deep neural network for panoptic segme...

Comparative analysis of deep learning approaches for AgNOR-stained cytology samples interpretation

Cervical cancer is a public health problem, where the treatment has a be...