DeepAI AI Chat
Log In Sign Up

Location-aware Upsampling for Semantic Segmentation

by   Xiangyu He, et al.

Many successful learning targets such as dice loss and cross-entropy loss have enabled unprecedented breakthroughs in segmentation tasks. Beyond semantic supervision, this paper aims to introduce location prediction into semantic segmentation from a new viewpoint: let pixels determine their own coordinates. Based on this idea, we present a Location-aware Upsampling (LaU) that adaptively refines the interpolating coordinates with trainable offsets. Then, location-aware losses are established by encouraging pixels to move towards well-classified locations. An LaU is offset prediction coupled with interpolation, which is trained end-to-end to generate confidence score at each position from coarse to fine. Guided by location-aware losses, the new module can replace its plain counterpart e.g., bilinear upsampling in a plug-and-play manner to further boost the leading encoder-decoder approaches. Extensive experiments validate the consistent improvement over the state-of-the-art methods on benchmark datasets. Our code is available at


page 6

page 8

page 12

page 13


Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels

IoU losses are surrogates that directly optimize the Jaccard index. In s...

SAPA: Similarity-Aware Point Affiliation for Feature Upsampling

We introduce point affiliation into feature upsampling, a notion that de...

SalsaNext: Fast Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

In this paper, we introduce SalsaNext for the semantic segmentation of a...

LoG-CAN: local-global Class-aware Network for semantic segmentation of remote sensing images

Remote sensing images are known of having complex backgrounds, high intr...

Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentation

Sparsely annotated semantic segmentation (SASS) aims to train a segmenta...

RGB-T Semantic Segmentation with Location, Activation, and Sharpening

Semantic segmentation is important for scene understanding. To address t...

Side Adapter Network for Open-Vocabulary Semantic Segmentation

This paper presents a new framework for open-vocabulary semantic segment...

Code Repositories


The Pytorch implementation of "Location-aware Upsampling for Semantic Segmentation" (LaU)

view repo