Exploiting Diverse Characteristics and Adversarial Ambivalence for Domain Adaptive Segmentation

12/10/2020
by   Bowen Cai, et al.
0

Adapting semantic segmentation models to new domains is an important but challenging problem. Recently enlightening progress has been made, but the performance of existing methods are unsatisfactory on real datasets where the new target domain comprises of heterogeneous sub-domains (e.g., diverse weather characteristics). We point out that carefully reasoning about the multiple modalities in the target domain can improve the robustness of adaptation models. To this end, we propose a condition-guided adaptation framework that is empowered by a special attentive progressive adversarial training (APAT) mechanism and a novel self-training policy. The APAT strategy progressively performs condition-specific alignment and attentive global feature matching. The new self-training scheme exploits the adversarial ambivalences of easy and hard adaptation regions and the correlations among target sub-domains effectively. We evaluate our method (DCAA) on various adaptation scenarios where the target images vary in weather conditions. The comparisons against baselines and the state-of-the-art approaches demonstrate the superiority of DCAA over the competitors.

READ FULL TEXT

page 2

page 3

page 6

page 12

page 13

page 14

research
03/14/2022

ADAS: A Direct Adaptation Strategy for Multi-Target Domain Adaptive Semantic Segmentation

In this paper, we present a direct adaptation strategy (ADAS), which aim...
research
08/26/2019

Constructing Self-motivated Pyramid Curriculums for Cross-Domain Semantic Segmentation: A Non-Adversarial Approach

We propose a new approach, called self-motivated pyramid curriculum doma...
research
08/16/2021

Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation

In this work, we address the task of unsupervised domain adaptation (UDA...
research
05/07/2021

More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation

Feature alignment between domains is one of the mainstream methods for U...
research
12/08/2016

FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation

Fully convolutional models for dense prediction have proven successful f...
research
12/04/2018

Domain Attentive Fusion for End-to-end Dialect Identification with Unknown Target Domain

End-to-end deep learning language or dialect identification systems oper...
research
04/04/2019

On Direct Distribution Matching for Adapting Segmentation Networks

Minimization of distribution matching losses is a principled approach to...

Please sign up or login with your details

Forgot password? Click here to reset