Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation

03/08/2020
by   Zhedong Zheng, et al.
10

This paper focuses on the unsupervised domain adaptation of transferring the knowledge from the source domain to the target domain in the context of semantic segmentation. Existing approaches usually regard the pseudo label as the ground truth to fully exploit the unlabeled target-domain data. Yet the pseudo labels of the target-domain data are usually predicted by the model trained on the source domain. Thus, the generated labels inevitably contain the incorrect prediction due to the discrepancy between the training domain and the test domain, which could be transferred to the final adapted model and largely compromises the training process. To overcome the problem, this paper proposes to explicitly estimate the prediction uncertainty during training to rectify the pseudo label learning for unsupervised semantic segmentation adaptation. Given the input image, the model outputs the semantic segmentation prediction as well as the uncertainty of the prediction. Specifically, we model the uncertainty via the prediction variance and involve the uncertainty into the optimization objective. To verify the effectiveness of the proposed method, we evaluate the proposed method on two prevalent synthetic-to-real semantic segmentation benchmarks, i.e., GTA5 -> Cityscapes and SYNTHIA -> Cityscapes, as well as one cross-city benchmark, i.e., Cityscapes -> Oxford RobotCar. We demonstrate through extensive experiments that the proposed approach (1) dynamically sets different confidence thresholds according to the prediction variance, (2) rectifies the learning from noisy pseudo labels, and (3) achieves significant improvements over the conventional pseudo label learning and yields competitive performance on all three benchmarks.

READ FULL TEXT

page 3

page 6

page 9

page 10

research
03/09/2021

MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentation

Unsupervised domain adaptation (UDA) aims to transfer the knowledge from...
research
06/23/2021

Exploiting Negative Learning for Implicit Pseudo Label Rectification in Source-Free Domain Adaptive Semantic Segmentation

It is desirable to transfer the knowledge stored in a well-trained sourc...
research
08/06/2023

Cal-SFDA: Source-Free Domain-adaptive Semantic Segmentation with Differentiable Expected Calibration Error

The prevalence of domain adaptive semantic segmentation has prompted con...
research
04/14/2022

Unsupervised Domain Adaptation with Implicit Pseudo Supervision for Semantic Segmentation

Pseudo-labelling is a popular technique in unsuper-vised domain adaptati...
research
03/02/2023

Multi-Source Soft Pseudo-Label Learning with Domain Similarity-based Weighting for Semantic Segmentation

This paper describes a method of domain adaptive training for semantic s...
research
08/10/2023

SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentation

Unsupervised Domain Adaptation (UDA) aims to solve the problem of label ...
research
05/31/2021

Closer Look at the Uncertainty Estimation in Semantic Segmentation under Distributional Shift

While recent computer vision algorithms achieve impressive performance o...

Please sign up or login with your details

Forgot password? Click here to reset