Seeing Behind Things: Extending Semantic Segmentation to Occluded Regions

06/07/2019
by   Pulak Purkait, et al.
4

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that surpass the traditional machine learning approaches for segmentation by a large margin. These architectures predict the directly observable semantic category of each pixel by usually optimizing a cross entropy loss. In this work we push the limit of semantic segmentation towards predicting semantic labels of directly visible as well as occluded objects or objects parts, where the network's input is a single depth image. We group the semantic categories into one background and multiple foreground object groups, and we propose a modification of the standard cross-entropy loss to cope with the settings. In our experiments we demonstrate that a CNN trained by minimizing the proposed loss is able to predict semantic categories for visible and occluded object parts without requiring to increase the network size (compared to a standard segmentation task). The results are validated on a newly generated dataset (augmented from SUNCG) dataset.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
05/06/2019

SEMEDA: Enhancing Segmentation Precision with Semantic Edge Aware Loss

While nowadays deep neural networks achieve impressive performances on s...
research
12/28/2018

Coarse-to-fine Semantic Segmentation from Image-level Labels

Deep neural network-based semantic segmentation generally requires large...
research
02/23/2022

Amodal Panoptic Segmentation

Humans have the remarkable ability to perceive objects as a whole, even ...
research
02/17/2022

Detecting and Learning the Unknown in Semantic Segmentation

Semantic segmentation is a crucial component for perception in automated...
research
04/02/2021

Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentation

We address the problem of weakly-supervised semantic segmentation (WSSS)...
research
01/13/2020

Adversarial Loss for Semantic Segmentation of Aerial Imagery

Automatic building extraction from aerial imagery has several applicatio...
research
09/19/2018

Counting the uncountable: deep semantic density estimation from Space

We propose a new method to count objects of specific categories that are...

Please sign up or login with your details

Forgot password? Click here to reset