Optimal transport meets noisy label robust loss and MixUp regularization for domain adaptation

06/22/2022
by   Kilian Fatras, et al.
0

It is common in computer vision to be confronted with domain shift: images which have the same class but different acquisition conditions. In domain adaptation (DA), one wants to classify unlabeled target images using source labeled images. Unfortunately, deep neural networks trained on a source training set perform poorly on target images which do not belong to the training domain. One strategy to improve these performances is to align the source and target image distributions in an embedded space using optimal transport (OT). However OT can cause negative transfer, i.e. aligning samples with different labels, which leads to overfitting especially in the presence of label shift between domains. In this work, we mitigate negative alignment by explaining it as a noisy label assignment to target images. We then mitigate its effect by appropriate regularization. We propose to couple the MixUp regularization <cit.> with a loss that is robust to noisy labels in order to improve domain adaptation performance. We show in an extensive ablation study that a combination of the two techniques is critical to achieve improved performance. Finally, we evaluate our method, called mixunbot, on several benchmarks and real-world DA problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2018

Optimal Transport for Multi-source Domain Adaptation under Target Shift

In this paper, we propose to tackle the problem of reducing discrepancie...
research
10/14/2016

Theoretical Analysis of Domain Adaptation with Optimal Transport

Domain adaptation (DA) is an important and emerging field of machine lea...
research
01/02/2019

On Minimum Discrepancy Estimation for Deep Domain Adaptation

In the presence of large sets of labeled data, Deep Learning (DL) has ac...
research
05/26/2020

Keep it Simple: Image Statistics Matching for Domain Adaptation

Applying an object detector, which is neither trained nor fine-tuned on ...
research
01/15/2022

Deep Optimal Transport on SPD Manifolds for Domain Adaptation

The domain adaption (DA) problem on symmetric positive definite (SPD) ma...
research
03/31/2022

Partial Coupling of Optimal Transport for Spoken Language Identification

In order to reduce domain discrepancy to improve the performance of cros...
research
05/07/2020

Source-Relaxed Domain Adaptation for Image Segmentation

Domain adaptation (DA) has drawn high interests for its capacity to adap...

Please sign up or login with your details

Forgot password? Click here to reset