Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentation

01/26/2021
by   Pan Zhang, et al.
8

Self-training is a competitive approach in domain adaptive segmentation, which trains the network with the pseudo labels on the target domain. However inevitably, the pseudo labels are noisy and the target features are dispersed due to the discrepancy between source and target domains. In this paper, we rely on representative prototypes, the feature centroids of classes, to address the two issues for unsupervised domain adaptation. In particular, we take one step further and exploit the feature distances from prototypes that provide richer information than mere prototypes. Specifically, we use it to estimate the likelihood of pseudo labels to facilitate online correction in the course of training. Meanwhile, we align the prototypical assignments based on relative feature distances for two different views of the same target, producing a more compact target feature space. Moreover, we find that distilling the already learned knowledge to a self-supervised pretrained model further boosts the performance. Our method shows tremendous performance advantage over state-of-the-art methods. We will make the code publicly available.

READ FULL TEXT

page 7

page 16

page 17

page 18

04/14/2022

Unsupervised Domain Adaptation with Implicit Pseudo Supervision for Semantic Segmentation

Pseudo-labelling is a popular technique in unsuper-vised domain adaptati...
05/05/2021

Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation

Deep convolutional neural networks have considerably improved state-of-t...
04/16/2022

Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation

A thriving trend for domain adaptive segmentation endeavors to generate ...
03/15/2022

Smoothing Matters: Momentum Transformer for Domain Adaptive Semantic Segmentation

After the great success of Vision Transformer variants (ViTs) in compute...
06/10/2022

Unsupervised Foggy Scene Understanding via Self Spatial-Temporal Label Diffusion

Understanding foggy image sequence in the driving scenes is critical for...
05/27/2021

Unsupervised Adaptive Semantic Segmentation with Local Lipschitz Constraint

Recent advances in unsupervised domain adaptation have seen considerable...
12/09/2021

Adaptive Methods for Aggregated Domain Generalization

Domain generalization involves learning a classifier from a heterogeneou...

Code Repositories

ProDA

Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentation (CVPR 2021)


view repo

My_ProDA

My ProDA code for UDASeg on foggy scences


view repo