DeepAI AI Chat
Log In Sign Up

Location-aware Upsampling for Semantic Segmentation

11/13/2019
by   Xiangyu He, et al.
ia.ac.cn
34

Many successful learning targets such as dice loss and cross-entropy loss have enabled unprecedented breakthroughs in segmentation tasks. Beyond semantic supervision, this paper aims to introduce location prediction into semantic segmentation from a new viewpoint: let pixels determine their own coordinates. Based on this idea, we present a Location-aware Upsampling (LaU) that adaptively refines the interpolating coordinates with trainable offsets. Then, location-aware losses are established by encouraging pixels to move towards well-classified locations. An LaU is offset prediction coupled with interpolation, which is trained end-to-end to generate confidence score at each position from coarse to fine. Guided by location-aware losses, the new module can replace its plain counterpart e.g., bilinear upsampling in a plug-and-play manner to further boost the leading encoder-decoder approaches. Extensive experiments validate the consistent improvement over the state-of-the-art methods on benchmark datasets. Our code is available at https://github.com/HolmesShuan/Location-aware-Upsampling-for-Semantic-Segmentation

READ FULL TEXT

page 6

page 8

page 12

page 13

02/11/2023

Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels

IoU losses are surrogates that directly optimize the Jaccard index. In s...
09/26/2022

SAPA: Similarity-Aware Point Affiliation for Feature Upsampling

We introduce point affiliation into feature upsampling, a notion that de...
03/07/2020

SalsaNext: Fast Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

In this paper, we introduce SalsaNext for the semantic segmentation of a...
03/14/2023

LoG-CAN: local-global Class-aware Network for semantic segmentation of remote sensing images

Remote sensing images are known of having complex backgrounds, high intr...
03/21/2022

Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentation

Sparsely annotated semantic segmentation (SASS) aims to train a segmenta...
10/26/2022

RGB-T Semantic Segmentation with Location, Activation, and Sharpening

Semantic segmentation is important for scene understanding. To address t...
02/23/2023

Side Adapter Network for Open-Vocabulary Semantic Segmentation

This paper presents a new framework for open-vocabulary semantic segment...

Code Repositories

Location-aware-Upsampling-for-Semantic-Segmentation

The Pytorch implementation of "Location-aware Upsampling for Semantic Segmentation" (LaU)


view repo