DeepAI AI Chat
Log In Sign Up

Deep Hierarchical Parsing for Semantic Segmentation

by   Abhishek Sharma, et al.
University of Maryland

This paper proposes a learning-based approach to scene parsing inspired by the deep Recursive Context Propagation Network (RCPN). RCPN is a deep feed-forward neural network that utilizes the contextual information from the entire image, through bottom-up followed by top-down context propagation via random binary parse trees. This improves the feature representation of every super-pixel in the image for better classification into semantic categories. We analyze RCPN and propose two novel contributions to further improve the model. We first analyze the learning of RCPN parameters and discover the presence of bypass error paths in the computation graph of RCPN that can hinder contextual propagation. We propose to tackle this problem by including the classification loss of the internal nodes of the random parse trees in the original RCPN loss function. Secondly, we use an MRF on the parse tree nodes to model the hierarchical dependency present in the output. Both modifications provide performance boosts over the original RCPN and the new system achieves state-of-the-art performance on Stanford Background, SIFT-Flow and Daimler urban datasets.


CTNet: Context-based Tandem Network for Semantic Segmentation

Contextual information has been shown to be powerful for semantic segmen...

A Re-ranking Model for Dependency Parser with Recursive Convolutional Neural Network

In this work, we address the problem to model all the nodes (words or ph...

Multi-hypothesis contextual modeling for semantic segmentation

Semantic segmentation (i.e. image parsing) aims to annotate each image p...

Efficient piecewise training of deep structured models for semantic segmentation

Recent advances in semantic image segmentation have mostly been achieved...

SegForestNet: Spatial-Partitioning-Based Aerial Image Segmentation

Aerial image analysis, specifically the semantic segmentation thereof, i...

Learning Dynamic Hierarchical Models for Anytime Scene Labeling

With increasing demand for efficient image and video analysis, test-time...

Context-based Deep Learning Architecture with Optimal Integration Layer for Image Parsing

Deep learning models have been efficient lately on image parsing tasks. ...