Sparse Spatial Attention Network for Semantic Segmentation

09/04/2021
by   Mengyu Liu, et al.
0

The spatial attention mechanism captures long-range dependencies by aggregating global contextual information to each query location, which is beneficial for semantic segmentation. In this paper, we present a sparse spatial attention network (SSANet) to improve the efficiency of the spatial attention mechanism without sacrificing the performance. Specifically, a sparse non-local (SNL) block is proposed to sample a subset of key and value elements for each query element to capture long-range relations adaptively and generate a sparse affinity matrix to aggregate contextual information efficiently. Experimental results show that the proposed approach outperforms other context aggregation methods and achieves state-of-the-art performance on the Cityscapes, PASCAL Context and ADE20K datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2023

SACANet: scene-aware class attention network for semantic segmentation of remote sensing images

Spatial attention mechanism has been widely used in semantic segmentatio...
research
08/25/2020

Dynamic deformable attention (DDANet) for semantic segmentation

Deep learning based medical image segmentation is an important step with...
research
12/17/2020

Semi-Global Shape-aware Network

Non-local operations are usually used to capture long-range dependencies...
research
03/03/2021

Non-local Channel Aggregation Network for Single Image Rain Removal

Rain streaks showing in images or videos would severely degrade the perf...
research
12/09/2018

Joint Vertebrae Identification and Localization in Spinal CT Images by Combining Short- and Long-Range Contextual Information

Automatic vertebrae identification and localization from arbitrary CT im...
research
11/28/2018

CCNet: Criss-Cross Attention for Semantic Segmentation

Long-range dependencies can capture useful contextual information to ben...
research
09/13/2020

Efficient Folded Attention for 3D Medical Image Reconstruction and Segmentation

Recently, 3D medical image reconstruction (MIR) and segmentation (MIS) b...

Please sign up or login with your details

Forgot password? Click here to reset