Unsupervised domain adaptation with non-stochastic missing data

09/16/2021
by   Matthieu Kirchmeyer, et al.
0

We consider unsupervised domain adaptation (UDA) for classification problems in the presence of missing data in the unlabelled target domain. More precisely, motivated by practical applications, we analyze situations where distribution shift exists between domains and where some components are systematically absent on the target domain without available supervision for imputing the missing target components. We propose a generative approach for imputation. Imputation is performed in a domain-invariant latent space and leverages indirect supervision from a complete source domain. We introduce a single model performing joint adaptation, imputation and classification which, under our assumptions, minimizes an upper bound of its target generalization error and performs well under various representative divergence families (H-divergence, Optimal Transport). Moreover, we compare the target error of our Adaptation-imputation framework and the "ideal" target error of a UDA classifier without missing target components. Our model is further improved with self-training, to bring the learned source and target class posterior distributions closer. We perform experiments on three families of datasets of different modalities: a classical digit classification benchmark, the Amazon product reviews dataset both commonly used in UDA and real-world digital advertising datasets. We show the benefits of jointly performing adaptation, classification and imputation on these datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/03/2020

Domain Adaptation with Incomplete Target Domains

Domain adaptation, as a task of reducing the annotation cost in a target...
research
10/24/2022

IT-RUDA: Information Theory Assisted Robust Unsupervised Domain Adaptation

Distribution shift between train (source) and test (target) datasets is ...
research
09/17/2019

Using Latent Codes for Class Imbalance Problem in Unsupervised Domain Adaptation

We address the problem of severe class imbalance in unsupervised domain ...
research
05/24/2017

Joint Distribution Optimal Transportation for Domain Adaptation

This paper deals with the unsupervised domain adaptation problem, where ...
research
11/03/2022

Domain Adaptation under Missingness Shift

Rates of missing data often depend on record-keeping policies and thus m...
research
04/18/2022

Understanding Gradual Domain Adaptation: Improved Analysis, Optimal Path and Beyond

The vast majority of existing algorithms for unsupervised domain adaptat...
research
10/23/2022

MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences

Existing multimodal tasks mostly target at the complete input modality s...

Please sign up or login with your details

Forgot password? Click here to reset