Efficient piecewise training of deep structured models for semantic segmentation

04/04/2015
by   Guosheng Lin, et al.
0

Recent advances in semantic image segmentation have mostly been achieved by training deep convolutional neural networks (CNNs). We show how to improve semantic segmentation through the use of contextual information; specifically, we explore `patch-patch' context between image regions, and `patch-background' context. For learning from the patch-patch context, we formulate Conditional Random Fields (CRFs) with CNN-based pairwise potential functions to capture semantic correlations between neighboring patches. Efficient piecewise training of the proposed deep structured model is then applied to avoid repeated expensive CRF inference for back propagation. For capturing the patch-background context, we show that a network design with traditional multi-scale image input and sliding pyramid pooling is effective for improving performance. Our experimental results set new state-of-the-art performance on a number of popular semantic segmentation datasets, including NYUDv2, PASCAL VOC 2012, PASCAL-Context, and SIFT-flow. In particular, we achieve an intersection-over-union score of 78.0 on the challenging PASCAL VOC 2012 dataset.

READ FULL TEXT
research
03/10/2016

Exploring Context with Deep Structured models for Semantic Segmentation

State-of-the-art semantic image segmentation methods are mostly based on...
research
06/06/2015

Deeply Learning the Messages in Message Passing Inference

Deep structured output learning shows great promise in tasks like semant...
research
12/02/2014

Feedforward semantic segmentation with zoom-out features

We introduce a purely feed-forward architecture for semantic segmentatio...
research
11/20/2016

RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation

Recently, very deep convolutional neural networks (CNNs) have shown outs...
research
03/28/2016

Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs

In this work we propose a structured prediction technique that combines ...
research
03/15/2016

Combining the Best of Convolutional Layers and Recurrent Layers: A Hybrid Network for Semantic Segmentation

State-of-the-art results of semantic segmentation are established by Ful...
research
02/07/2013

A Fast Learning Algorithm for Image Segmentation with Max-Pooling Convolutional Networks

We present a fast algorithm for training MaxPooling Convolutional Networ...

Please sign up or login with your details

Forgot password? Click here to reset