Semantic Segmentation with Labeling Uncertainty and Class Imbalance

02/08/2021
by   Patrik Olã Bressan, et al.
11

Recently, methods based on Convolutional Neural Networks (CNN) achieved impressive success in semantic segmentation tasks. However, challenges such as the class imbalance and the uncertainty in the pixel-labeling process are not completely addressed. As such, we present a new approach that calculates a weight for each pixel considering its class and uncertainty during the labeling process. The pixel-wise weights are used during training to increase or decrease the importance of the pixels. Experimental results show that the proposed approach leads to significant improvements in three challenging segmentation tasks in comparison to baseline methods. It was also proved to be more invariant to noise. The approach presented here may be used within a wide range of semantic segmentation methods to improve their robustness.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

page 6

page 7

page 8

page 9

page 10

page 11

page 13

07/26/2016

Region-based semantic segmentation with end-to-end training

We propose a novel method for semantic segmentation, the task of labelin...
10/16/2020

Automated Iterative Training of Convolutional Neural Networks for Tree Skeleton Segmentation

Training of convolutional neural networks for semantic segmentation requ...
01/24/2019

Application of Decision Rules for Handling Class Imbalance in Semantic Segmentation

As part of autonomous car driving systems, semantic segmentation is an e...
07/27/2015

Relating Cascaded Random Forests to Deep Convolutional Neural Networks for Semantic Segmentation

We consider the task of pixel-wise semantic segmentation given a small s...
03/14/2018

Combining Multi-level Contexts of Superpixel using Convolutional Neural Networks to perform Natural Scene Labeling

Modern deep learning algorithms have triggered various image segmentatio...
05/03/2018

Pixel-wise Attentional Gating for Parsimonious Pixel Labeling

To achieve parsimonious inference in per-pixel labeling tasks with a lim...
10/29/2021

Deep Deterministic Uncertainty for Semantic Segmentation

We extend Deep Deterministic Uncertainty (DDU), a method for uncertainty...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.