Shallow Features Guide Unsupervised Domain Adaptation for Semantic Segmentation at Class Boundaries

10/06/2021
by   Adriano Cardace, et al.
0

Although deep neural networks have achieved remarkable results for the task of semantic segmentation, they usually fail to generalize towards new domains, especially when performing synthetic-to-real adaptation. Such domain shift is particularly noticeable along class boundaries, invalidating one of the main goals of semantic segmentation that consists in obtaining sharp segmentation masks. In this work, we specifically address this core problem in the context of Unsupervised Domain Adaptation and present a novel low-level adaptation strategy that allows us to obtain sharp predictions. Moreover, inspired by recent self-training techniques, we introduce an effective data augmentation that alleviates the noise typically present at semantic boundaries when employing pseudo-labels for self-training. Our contributions can be easily integrated into other popular adaptation frameworks, and extensive experiments show that they effectively improve performance along class boundaries.

READ FULL TEXT

page 1

page 4

page 8

page 14

page 15

page 16

page 17

research
09/02/2019

Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation

Deep learning-based semantic segmentation methods have an intrinsic limi...
research
11/20/2019

Unsupervised Domain Adaptation by Optical Flow Augmentation in Semantic Segmentation

It is expensive to generate real-life image labels and there is a domain...
research
11/25/2020

Unsupervised Domain Adaptation in Semantic Segmentation via Orthogonal and Clustered Embeddings

Deep learning frameworks allowed for a remarkable advancement in semanti...
research
01/10/2023

Explaining Deep Models through Forgettable Learning Dynamics

Even though deep neural networks have shown tremendous success in countl...
research
03/17/2023

Bidirectional Domain Mixup for Domain Adaptive Semantic Segmentation

Mixup provides interpolated training samples and allows the model to obt...
research
04/29/2021

Rethinking Ensemble-Distillation for Semantic Segmentation Based Unsupervised Domain Adaptation

Recent researches on unsupervised domain adaptation (UDA) have demonstra...
research
04/24/2023

Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Driving

Deep neural networks (DNNs) have proven their capabilities in many areas...

Please sign up or login with your details

Forgot password? Click here to reset