DeepAI AI Chat
Log In Sign Up

ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation

by   Di Lin, et al.

Large-scale data is of crucial importance for learning semantic segmentation models, but annotating per-pixel masks is a tedious and inefficient procedure. We note that for the topic of interactive image segmentation, scribbles are very widely used in academic research and commercial software, and are recognized as one of the most user-friendly ways of interacting. In this paper, we propose to use scribbles to annotate images, and develop an algorithm to train convolutional networks for semantic segmentation supervised by scribbles. Our algorithm is based on a graphical model that jointly propagates information from scribbles to unmarked pixels and learns network parameters. We present competitive object semantic segmentation results on the PASCAL VOC dataset by using scribbles as annotations. Scribbles are also favored for annotating stuff (e.g., water, sky, grass) that has no well-defined shape, and our method shows excellent results on the PASCAL-CONTEXT dataset thanks to extra inexpensive scribble annotations. Our scribble annotations on PASCAL VOC are available at


page 2

page 3

page 4

page 5

page 6

page 8


Fully Connected Deep Structured Networks

Convolutional neural networks with many layers have recently been shown ...

Convolutional Feature Masking for Joint Object and Stuff Segmentation

The topic of semantic segmentation has witnessed considerable progress d...

Combining the Best of Graphical Models and ConvNets for Semantic Segmentation

We present a two-module approach to semantic segmentation that incorpora...

Hypergraph Convolutional Networks for Weakly-Supervised Semantic Segmentation

Semantic segmentation is a fundamental topic in computer vision. Several...

Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks

We propose learnable polyphase sampling (LPS), a pair of learnable down/...

An Interpretable Deep Semantic Segmentation Method for Earth Observation

Earth observation is fundamental for a range of human activities includi...

Deep Learning Superpixel Semantic Segmentation with Transparent Initialization and Sparse Encoder

Even though deep learning greatly improves the performance of semantic s...