Log In Sign Up

CTNet: Context-based Tandem Network for Semantic Segmentation

by   Zechao Li, et al.

Contextual information has been shown to be powerful for semantic segmentation. This work proposes a novel Context-based Tandem Network (CTNet) by interactively exploring the spatial contextual information and the channel contextual information, which can discover the semantic context for semantic segmentation. Specifically, the Spatial Contextual Module (SCM) is leveraged to uncover the spatial contextual dependency between pixels by exploring the correlation between pixels and categories. Meanwhile, the Channel Contextual Module (CCM) is introduced to learn the semantic features including the semantic feature maps and class-specific features by modeling the long-term semantic dependence between channels. The learned semantic features are utilized as the prior knowledge to guide the learning of SCM, which can make SCM obtain more accurate long-range spatial dependency. Finally, to further improve the performance of the learned representations for semantic segmentation, the results of the two context modules are adaptively integrated to achieve better results. Extensive experiments are conducted on three widely-used datasets, i.e., PASCAL-Context, ADE20K and PASCAL VOC2012. The results demonstrate the superior performance of the proposed CTNet by comparison with several state-of-the-art methods.


page 1

page 2

page 5

page 7

page 8

page 9

page 10

page 11


Learning to Predict Context-adaptive Convolution for Semantic Segmentation

Long-range contextual information is essential for achieving high-perfor...

DCANet: Dense Context-Aware Network for Semantic Segmentation

As the superiority of context information gradually manifests in advance...

BiCANet: Bi-directional Contextual Aggregating Network for Image Semantic Segmentation

Exploring contextual information in convolution neural networks (CNNs) h...

Semantic Referee: A Neural-Symbolic Framework for Enhancing Geospatial Semantic Segmentation

Understanding why machine learning algorithms may fail is usually the ta...

Masked Supervised Learning for Semantic Segmentation

Self-attention is of vital importance in semantic segmentation as it ena...

Deep Hierarchical Parsing for Semantic Segmentation

This paper proposes a learning-based approach to scene parsing inspired ...

Learning Statistical Texture for Semantic Segmentation

Existing semantic segmentation works mainly focus on learning the contex...