Your Classifier can Secretly Suffice Multi-Source Domain Adaptation

03/20/2021
by   Naveen Venkat, et al.
1

Multi-Source Domain Adaptation (MSDA) deals with the transfer of task knowledge from multiple labeled source domains to an unlabeled target domain, under a domain-shift. Existing methods aim to minimize this domain-shift using auxiliary distribution alignment objectives. In this work, we present a different perspective to MSDA wherein deep models are observed to implicitly align the domains under label supervision. Thus, we aim to utilize implicit alignment without additional training objectives to perform adaptation. To this end, we use pseudo-labeled target samples and enforce a classifier agreement on the pseudo-labels, a process called Self-supervised Implicit Alignment (SImpAl). We find that SImpAl readily works even under category-shift among the source domains. Further, we propose classifier agreement as a cue to determine the training convergence, resulting in a simple training algorithm. We provide a thorough evaluation of our approach on five benchmarks, along with detailed insights into each component of our approach.

READ FULL TEXT
research
09/09/2021

Generation, augmentation, and alignment: A pseudo-source domain based method for source-free domain adaptation

Conventional unsupervised domain adaptation (UDA) methods need to access...
research
07/08/2020

Combating Domain Shift with Self-Taught Labeling

We present a novel method to combat domain shift when adapting classific...
research
09/26/2019

Unsupervised Domain Adaptation through Self-Supervision

This paper addresses unsupervised domain adaptation, the setting where l...
research
04/04/2023

Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptation

We use information-theoretic tools to derive a novel analysis of Multi-s...
research
04/27/2021

Graphical Modeling for Multi-Source Domain Adaptation

Multi-Source Domain Adaptation (MSDA) focuses on transferring the knowle...
research
06/09/2020

Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation

We present an approach for unsupervised domain adaptation—with a strong ...
research
12/08/2021

Pareto Domain Adaptation

Domain adaptation (DA) attempts to transfer the knowledge from a labeled...

Please sign up or login with your details

Forgot password? Click here to reset