DeepAI AI Chat
Log In Sign Up

Convolutional Feature Masking for Joint Object and Stuff Segmentation

12/03/2014
by   Jifeng Dai, et al.
Microsoft
0

The topic of semantic segmentation has witnessed considerable progress due to the powerful features learned by convolutional neural networks (CNNs). The current leading approaches for semantic segmentation exploit shape information by extracting CNN features from masked image regions. This strategy introduces artificial boundaries on the images and may impact the quality of the extracted features. Besides, the operations on the raw image domain require to compute thousands of networks on a single image, which is time-consuming. In this paper, we propose to exploit shape information via masking convolutional features. The proposal segments (e.g., super-pixels) are treated as masks on the convolutional feature maps. The CNN features of segments are directly masked out from these maps and used to train classifiers for recognition. We further propose a joint method to handle objects and "stuff" (e.g., grass, sky, water) in the same framework. State-of-the-art results are demonstrated on benchmarks of PASCAL VOC and new PASCAL-CONTEXT, with a compelling computational speed.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 9

04/18/2016

ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation

Large-scale data is of crucial importance for learning semantic segmenta...
08/08/2022

Exploiting Shape Cues for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation (WSSS) aims to produce pixel-wis...
09/10/2015

STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation

Recently, significant improvement has been made on semantic object segme...
09/29/2016

CNN-aware Binary Map for General Semantic Segmentation

In this paper we introduce a novel method for general semantic segmentat...
11/21/2016

Efficient Convolutional Neural Network with Binary Quantization Layer

In this paper we introduce a novel method for segmentation that can bene...
06/26/2018

Deep Feature Factorization For Concept Discovery

We propose Deep Feature Factorization (DFF), a method capable of localiz...
12/14/2014

Combining the Best of Graphical Models and ConvNets for Semantic Segmentation

We present a two-module approach to semantic segmentation that incorpora...

Code Repositories

MNC

Instance-aware Semantic Segmentation via Multi-task Network Cascades


view repo

MNC

Instance-aware Semantic Segmentation via Multi-task Network Cascades


view repo

MNC

Instance-aware Semantic Segmentation via Multi-task Network Cascades


view repo