Interventional Domain Adaptation

11/07/2020
by   Jun Wen, et al.
0

Domain adaptation (DA) aims to transfer discriminative features learned from source domain to target domain. Most of DA methods focus on enhancing feature transferability through domain-invariance learning. However, source-learned discriminability itself might be tailored to be biased and unsafely transferable by spurious correlations, i.e., part of source-specific features are correlated with category labels. We find that standard domain-invariance learning suffers from such correlations and incorrectly transfers the source-specifics. To address this issue, we intervene in the learning of feature discriminability using unlabeled target data to guide it to get rid of the domain-specific part and be safely transferable. Concretely, we generate counterfactual features that distinguish the domain-specifics from domain-sharable part through a novel feature intervention strategy. To prevent the residence of domain-specifics, the feature discriminability is trained to be invariant to the mutations in the domain-specifics of counterfactual features. Experimenting on typical one-to-one unsupervised domain adaptation and challenging domain-agnostic adaptation tasks, the consistent performance improvements of our method over state-of-the-art approaches validate that the learned discriminative features are more safely transferable and generalize well to novel domains.

READ FULL TEXT
research
08/03/2021

Generalized Source-free Domain Adaptation

Domain adaptation (DA) aims to transfer the knowledge learned from a sou...
research
09/18/2022

Domain Classification-based Source-specific Term Penalization for Domain Adaptation in Hate-speech Detection

State-of-the-art approaches for hate-speech detection usually exhibit po...
research
01/05/2022

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledg...
research
01/01/2023

Discriminative Radial Domain Adaptation

Domain adaptation methods reduce domain shift typically by learning doma...
research
05/04/2023

ReMask: A Robust Information-Masking Approach for Domain Counterfactual Generation

Domain shift is a big challenge in NLP, thus, many approaches resort to ...
research
02/24/2022

DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation

Natural language processing (NLP) algorithms have become very successful...
research
05/23/2023

Pulling Target to Source: A New Perspective on Domain Adaptive Semantic Segmentation

Domain adaptive semantic segmentation aims to transfer knowledge from a ...

Please sign up or login with your details

Forgot password? Click here to reset