DeepAI AI Chat
Log In Sign Up

Weakly Supervised Semantic Image Segmentation with Self-correcting Networks

by   Mostafa S. Ibrahim, et al.
Simon Fraser University

Building a large image dataset with high-quality object masks for semantic segmentation is costly and time consuming. In this paper, we reduce the data preparation cost by leveraging weak supervision in the form of object bounding boxes. To accomplish this, we propose a principled framework that trains a deep convolutional segmentation model that combines a large set of weakly supervised images (having only object bounding box labels) with a small set of fully supervised images (having semantic segmentation labels and box labels). Our framework trains the primary segmentation model with the aid of an ancillary model that generates initial segmentation labels for the weakly supervised instances and a self-correction module that improves the generated labels during training using the increasingly accurate primary model. We introduce two variants of the self-correction module using either linear or convolutional functions. Experiments on the PASCAL VOC 2012 and Cityscape datasets show that our models trained with a small fully supervised set perform similar to, or better than, models trained with a large fully supervised set while requiring 7x less annotation effort.


page 3

page 8


Medical image segmentation with imperfect 3D bounding boxes

The development of high quality medical image segmentation algorithms de...

Simple Does It: Weakly Supervised Instance and Semantic Segmentation

Semantic labelling and instance segmentation are two tasks that require ...

Weakly-Supervised Semantic Segmentation by Learning Label Uncertainty

Since the rise of deep learning, many computer vision tasks have seen si...

Data Selection for training Semantic Segmentation CNNs with cross-dataset weak supervision

Training convolutional networks for semantic segmentation with strong (p...

Weakly Supervised Volumetric Segmentation via Self-taught Shape Denoising Model

Weakly supervised segmentation is an important problem in medical image ...

Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentation

We address the problem of weakly-supervised semantic segmentation (WSSS)...

Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentation

To minimize the annotation costs associated with the training of semanti...