Semantic Segmentation with Labeling Uncertainty and Class Imbalance

by   Patrik Olã Bressan, et al.

Recently, methods based on Convolutional Neural Networks (CNN) achieved impressive success in semantic segmentation tasks. However, challenges such as the class imbalance and the uncertainty in the pixel-labeling process are not completely addressed. As such, we present a new approach that calculates a weight for each pixel considering its class and uncertainty during the labeling process. The pixel-wise weights are used during training to increase or decrease the importance of the pixels. Experimental results show that the proposed approach leads to significant improvements in three challenging segmentation tasks in comparison to baseline methods. It was also proved to be more invariant to noise. The approach presented here may be used within a wide range of semantic segmentation methods to improve their robustness.



There are no comments yet.


page 5

page 6

page 7

page 8

page 9

page 10

page 11

page 13


Region-based semantic segmentation with end-to-end training

We propose a novel method for semantic segmentation, the task of labelin...

Automated Iterative Training of Convolutional Neural Networks for Tree Skeleton Segmentation

Training of convolutional neural networks for semantic segmentation requ...

Application of Decision Rules for Handling Class Imbalance in Semantic Segmentation

As part of autonomous car driving systems, semantic segmentation is an e...

Relating Cascaded Random Forests to Deep Convolutional Neural Networks for Semantic Segmentation

We consider the task of pixel-wise semantic segmentation given a small s...

Combining Multi-level Contexts of Superpixel using Convolutional Neural Networks to perform Natural Scene Labeling

Modern deep learning algorithms have triggered various image segmentatio...

Pixel-wise Attentional Gating for Parsimonious Pixel Labeling

To achieve parsimonious inference in per-pixel labeling tasks with a lim...

Deep Deterministic Uncertainty for Semantic Segmentation

We extend Deep Deterministic Uncertainty (DDU), a method for uncertainty...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.