InstanceCut: from Edges to Instances with MultiCut

11/24/2016
by   Alexander Kirillov, et al.
0

This work addresses the task of instance-aware semantic segmentation. Our key motivation is to design a simple method with a new modelling-paradigm, which therefore has a different trade-off between advantages and disadvantages compared to known approaches. Our approach, we term InstanceCut, represents the problem by two output modalities: (i) an instance-agnostic semantic segmentation and (ii) all instance-boundaries. The former is computed from a standard convolutional neural network for semantic segmentation, and the latter is derived from a new instance-aware edge detection model. To reason globally about the optimal partitioning of an image into instances, we combine these two modalities into a novel MultiCut formulation. We evaluate our approach on the challenging CityScapes dataset. Despite the conceptual simplicity of our approach, we achieve the best result among all published methods, and perform particularly well for rare object classes.

READ FULL TEXT

page 1

page 3

page 8

page 12

page 13

research
12/14/2015

Instance-aware Semantic Segmentation via Multi-task Network Cascades

Semantic segmentation research has recently witnessed rapid progress, bu...
research
10/10/2019

Panoptic-DeepLab

We present Panoptic-DeepLab, a bottom-up and single-shot approach for pa...
research
01/08/2019

Panoptic Feature Pyramid Networks

The recently introduced panoptic segmentation task has renewed our commu...
research
08/31/2021

SemIE: Semantically-aware Image Extrapolation

We propose a semantically-aware novel paradigm to perform image extrapol...
research
01/03/2018

Panoptic Segmentation

We propose and study a novel 'Panoptic Segmentation' (PS) task. Panoptic...
research
06/03/2019

Panoptic Edge Detection

Pursuing more complete and coherent scene understanding towards realisti...
research
03/15/2023

PENet: A Joint Panoptic Edge Detection Network

In recent years, compact and efficient scene understanding representatio...

Please sign up or login with your details

Forgot password? Click here to reset