Adapting to Latent Subgroup Shifts via Concepts and Proxies

12/21/2022
by   Ibrahim Alabdulmohsin, et al.
1

We address the problem of unsupervised domain adaptation when the source domain differs from the target domain because of a shift in the distribution of a latent subgroup. When this subgroup confounds all observed data, neither covariate shift nor label shift assumptions apply. We show that the optimal target predictor can be non-parametrically identified with the help of concept and proxy variables available only in the source domain, and unlabeled data from the target. The identification results are constructive, immediately suggesting an algorithm for estimating the optimal predictor in the target. For continuous observations, when this algorithm becomes impractical, we propose a latent variable model specific to the data generation process at hand. We show how the approach degrades as the size of the shift changes, and verify that it outperforms both covariate and label shift adjustment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/29/2019

Hidden Covariate Shift: A Minimal Assumption For Domain Adaptation

Unsupervised Domain Adaptation aims to learn a model on a source domain ...
research
11/03/2022

Domain Adaptation under Missingness Shift

Rates of missing data often depend on record-keeping policies and thus m...
research
06/23/2023

Prediction under Latent Subgroup Shifts with High-Dimensional Observations

We introduce a new approach to prediction in graphical models with laten...
research
10/01/2019

Robust learning with the Hilbert-Schmidt independence criterion

We investigate the use of a non-parametric independence measure, the Hil...
research
02/27/2023

Statistical Learning under Heterogenous Distribution Shift

This paper studies the prediction of a target 𝐳 from a pair of random va...
research
02/26/2020

Understanding Self-Training for Gradual Domain Adaptation

Machine learning systems must adapt to data distributions that evolve ov...
research
07/26/2022

Unsupervised Learning under Latent Label Shift

What sorts of structure might enable a learner to discover classes from ...

Please sign up or login with your details

Forgot password? Click here to reset