Semi-Global Shape-aware Network

12/17/2020
by   Pengju Zhang, et al.
0

Non-local operations are usually used to capture long-range dependencies via aggregating global context to each position recently. However, most of the methods cannot preserve object shapes since they only focus on feature similarity but ignore proximity between central and other positions for capturing long-range dependencies, while shape-awareness is beneficial to many computer vision tasks. In this paper, we propose a Semi-Global Shape-aware Network (SGSNet) considering both feature similarity and proximity for preserving object shapes when modeling long-range dependencies. A hierarchical way is taken to aggregate global context. In the first level, each position in the whole feature map only aggregates contextual information in vertical and horizontal directions according to both similarity and proximity. And then the result is input into the second level to do the same operations. By this hierarchical way, each central position gains supports from all other positions, and the combination of similarity and proximity makes each position gain supports mostly from the same semantic object. Moreover, we also propose a linear time algorithm for the aggregation of contextual information, where each of rows and columns in the feature map is treated as a binary tree to reduce similarity computation cost. Experiments on semantic segmentation and image retrieval show that adding SGSNet to existing networks gains solid improvements on both accuracy and efficiency.

READ FULL TEXT

page 6

page 7

research
09/04/2021

Sparse Spatial Attention Network for Semantic Segmentation

The spatial attention mechanism captures long-range dependencies by aggr...
research
03/03/2021

Non-local Channel Aggregation Network for Single Image Rain Removal

Rain streaks showing in images or videos would severely degrade the perf...
research
09/27/2019

Learnable Tree Filter for Structure-preserving Feature Transform

Learning discriminative global features plays a vital role in semantic s...
research
07/23/2019

Compact Global Descriptor for Neural Networks

Long-range dependencies modeling, widely used in capturing spatiotempora...
research
03/11/2021

Duplex Contextual Relation Network for Polyp Segmentation

Polyp segmentation is of great importance in the early diagnosis and tre...
research
04/25/2019

GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond

The Non-Local Network (NLNet) presents a pioneering approach for capturi...
research
12/07/2020

Rethinking Learnable Tree Filter for Generic Feature Transform

The Learnable Tree Filter presents a remarkable approach to model struct...

Please sign up or login with your details

Forgot password? Click here to reset