Gated Feedback Refinement Network for Coarse-to-Fine Dense Semantic Image Labeling

06/29/2018
by   Md Amirul Islam, et al.
2

Effective integration of local and global contextual information is crucial for semantic segmentation and dense image labeling. We develop two encoder-decoder based deep learning architectures to address this problem. We first propose a network architecture called Label Refinement Network (LRN) that predicts segmentation labels in a coarse-to-fine fashion at several spatial resolutions. In this network, we also define loss functions at several stages to provide supervision at different stages of training. However, there are limits to the quality of refinement possible if ambiguous information is passed forward. In order to address this issue, we also propose Gated Feedback Refinement Network (G-FRNet) that addresses this limitation. Initially, G-FRNet makes a coarse-grained prediction which it progressively refines to recover details by effectively integrating local and global contextual information during the refinement stages. This is achieved by gate units proposed in this work, that control information passed forward in order to resolve the ambiguity. Experiments were conducted on four challenging dense labeling datasets (CamVid, PASCAL VOC 2012, Horse-Cow Parsing, PASCAL-Person-Part, and SUN-RGBD). G-FRNet achieves state-of-the-art semantic segmentation results on the CamVid and Horse-Cow Parsing datasets and produces results competitive with the best performing approaches that appear in the literature for the other three datasets.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 7

page 9

page 10

page 11

page 12

03/01/2017

Label Refinement Network for Coarse-to-Fine Semantic Segmentation

We consider the problem of semantic image segmentation using deep convol...
04/23/2018

Progressive refinement: a method of coarse-to-fine image parsing using stacked network

To parse images into fine-grained semantic parts, the complex fine-grain...
12/14/2018

Multi-hypothesis contextual modeling for semantic segmentation

Semantic segmentation (i.e. image parsing) aims to annotate each image p...
11/02/2020

MARNet: Multi-Abstraction Refinement Network for 3D Point Cloud Analysis

Representation learning from 3D point clouds is challenging due to their...
11/24/2016

Recalling Holistic Information for Semantic Segmentation

Semantic segmentation requires a detailed labeling of image pixels by ob...
11/07/2016

High-Resolution Semantic Labeling with Convolutional Neural Networks

Convolutional neural networks (CNNs) have received increasing attention ...
05/23/2021

Coarse to Fine Multi-Resolution Temporal Convolutional Network

Temporal convolutional networks (TCNs) are a commonly used architecture ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.