MLAN: Multi-Level Adversarial Network for Domain Adaptive Semantic Segmentation

03/24/2021
by   Jiaxing Huang, et al.
0

Recent progresses in domain adaptive semantic segmentation demonstrate the effectiveness of adversarial learning (AL) in unsupervised domain adaptation. However, most adversarial learning based methods align source and target distributions at a global image level but neglect the inconsistency around local image regions. This paper presents a novel multi-level adversarial network (MLAN) that aims to address inter-domain inconsistency at both global image level and local region level optimally. MLAN has two novel designs, namely, region-level adversarial learning (RL-AL) and co-regularized adversarial learning (CR-AL). Specifically, RL-AL models prototypical regional context-relations explicitly in the feature space of a labelled source domain and transfers them to an unlabelled target domain via adversarial learning. CR-AL fuses region-level AL and image-level AL optimally via mutual regularization. In addition, we design a multi-level consistency map that can guide domain adaptation in both input space (i.e., image-to-image translation) and output space (i.e., self-training) effectively. Extensive experiments show that MLAN outperforms the state-of-the-art with a large margin consistently across multiple datasets.

READ FULL TEXT

page 2

page 5

page 14

research
07/07/2020

Contextual-Relation Consistent Domain Adaptation for Semantic Segmentation

Recent advances in unsupervised domain adaptation for semantic segmentat...
research
10/14/2021

Domain Adaptation on Semantic Segmentation with Separate Affine Transformation in Batch Normalization

In recent years, unsupervised domain adaptation (UDA) for semantic segme...
research
09/30/2019

MLSL: Multi-Level Self-Supervised Learning for Domain Adaptation with Spatially Independent and Semantically Consistent Labeling

Most of the recent Deep Semantic Segmentation algorithms suffer from lar...
research
04/01/2019

Significance-aware Information Bottleneck for Domain Adaptive Semantic Segmentation

For unsupervised domain adaptation problems, the strategy of aligning th...
research
02/10/2022

Consistency and Diversity induced Human Motion Segmentation

Subspace clustering is a classical technique that has been widely used f...
research
05/14/2019

Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection

We introduce a novel unsupervised domain adaptation approach for object ...
research
08/02/2022

Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonization

Image cartoonization is recently dominated by generative adversarial net...

Please sign up or login with your details

Forgot password? Click here to reset