Connecting sufficient conditions for domain adaptation: source-guided uncertainty, relaxed divergences and discrepancy localization

03/09/2022
by   Sofien Dhouib, et al.
0

Recent advances in domain adaptation establish that requiring a low risk on the source domain and equal feature marginals degrade the adaptation's performance. At the same time, empirical evidence shows that incorporating an unsupervised target domain term that pushes decision boundaries away from the high-density regions, along with relaxed alignment, improves adaptation. In this paper, we theoretically justify such observations via a new bound on the target risk, and we connect two notions of relaxation for divergence, namely β-relaxed divergences and localization. This connection allows us to incorporate the source domain's categorical structure into the relaxation of the considered divergence, provably resulting in a better handling of the label shift case in particular.

READ FULL TEXT

page 11

page 12

research
04/03/2020

Unsupervised Domain Adaptation with Progressive Domain Augmentation

Domain adaptation aims to exploit a label-rich source domain for learnin...
research
03/05/2019

Domain Adaptation with Asymmetrically-Relaxed Distribution Alignment

Domain adaptation addresses the common problem when the target distribut...
research
11/16/2022

Unsupervised Domain Adaptation Based on the Predictive Uncertainty of Models

Unsupervised domain adaptation (UDA) aims to improve the prediction perf...
research
07/12/2022

Domain Gap Estimation for Source Free Unsupervised Domain Adaptation with Many Classifiers

In theory, the success of unsupervised domain adaptation (UDA) largely r...
research
10/03/2022

Information-Theoretic Analysis of Unsupervised Domain Adaptation

This paper uses information-theoretic tools to analyze the generalizatio...
research
11/29/2020

Importance Weight Estimation and Generalization in Domain Adaptation under Label Shift

We study generalization under label shift in domain adaptation where the...
research
09/16/2022

Memory Consistent Unsupervised Off-the-Shelf Model Adaptation for Source-Relaxed Medical Image Segmentation

Unsupervised domain adaptation (UDA) has been a vital protocol for migra...

Please sign up or login with your details

Forgot password? Click here to reset