Theoretical Analysis of Domain Adaptation with Optimal Transport

10/14/2016
by   Ievgen Redko, et al.
0

Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of minimizing the divergence between source and target probability distributions. In this paper, we provide a theoretical study on the advantages that concepts borrowed from optimal transportation theory can bring to DA. In particular, we show that the Wasserstein metric can be used as a divergence measure between distributions to obtain generalization guarantees for three different learning settings: (i) classic DA with unsupervised target data (ii) DA combining source and target labeled data, (iii) multiple source DA. Based on the obtained results, we provide some insights showing when this analysis can be tighter than other existing frameworks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2022

Theoretical Guarantees for Domain Adaptation with Hierarchical Optimal Transport

Domain adaptation arises as an important problem in statistical learning...
research
06/22/2017

Coupled Support Vector Machines for Supervised Domain Adaptation

Popular domain adaptation (DA) techniques learn a classifier for the tar...
research
05/12/2023

Beyond invariant representation learning: linearly alignable latent spaces for efficient closed-form domain adaptation

Optimal transport (OT) is a powerful geometric tool used to compare and ...
research
10/29/2020

Domain adaptation under structural causal models

Domain adaptation (DA) arises as an important problem in statistical mac...
research
01/15/2022

Deep Optimal Transport on SPD Manifolds for Domain Adaptation

The domain adaption (DA) problem on symmetric positive definite (SPD) ma...
research
06/22/2022

Optimal transport meets noisy label robust loss and MixUp regularization for domain adaptation

It is common in computer vision to be confronted with domain shift: imag...
research
11/22/2019

Multi-source Distilling Domain Adaptation

Deep neural networks suffer from performance decay when there is domain ...

Please sign up or login with your details

Forgot password? Click here to reset