Virtual Mixup Training for Unsupervised Domain Adaptation

05/10/2019
by   Xudong Mao, et al.
0

We study the problem of unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain. Domain adversarial training is a promising approach and has been a basis for many state-of-the-art approaches in unsupervised domain adaptation. The idea of domain adversarial training is to align the feature space between the source domain and target domain by adversarially training a domain classifier and a feature encoder. Recently, cluster assumption has been applied to unsupervised domain adaptation and achieved strong performance. In this paper, we propose a new regularization method called Virtual Mixup Training (VMT), which is able to further constrain the hypothesis of cluster assumption. The idea of VMT is to impose a locally-Lipschitz constraint on the model by smoothing the output distribution along the lines between pairs of training samples. Unlike the traditional mixup model, our method constructs the combination samples without label information, allowing it to be applicable to unsupervised domain adaptation. The proposed method is generic and can be combined with existing methods using domain adversarial training. We combine VMT with a recent state-of-the-art model called VADA, and extensive experiments demonstrate that VMT significantly improves the performance of VADA on several domain adaptation benchmark datasets. For the challenging task of adapting MNIST to SVHN, when not using instance normalization, VMT improves the accuracy of VADA by over 30 accuracy of 96.4 train-on-target model. Code will be made publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/03/2023

Spectral Adversarial MixUp for Few-Shot Unsupervised Domain Adaptation

Domain shift is a common problem in clinical applications, where the tra...
research
02/23/2018

A DIRT-T Approach to Unsupervised Domain Adaptation

Domain adaptation refers to the problem of leveraging labeled data in a ...
research
06/10/2020

Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis

Multi-source unsupervised domain adaptation (MS-UDA) for sentiment analy...
research
08/19/2020

Virtual Adversarial Training in Feature Space to Improve Unsupervised Video Domain Adaptation

Virtual Adversarial Training has recently seen a lot of success in semi-...
research
04/14/2021

UDALM: Unsupervised Domain Adaptation through Language Modeling

In this work we explore Unsupervised Domain Adaptation (UDA) of pretrain...
research
06/29/2023

Cross-Inferential Networks for Source-free Unsupervised Domain Adaptation

One central challenge in source-free unsupervised domain adaptation (UDA...
research
09/14/2018

A Domain Agnostic Normalization Layer for Unsupervised Adversarial Domain Adaptation

We propose a normalization layer for unsupervised domain adaption in sem...

Please sign up or login with your details

Forgot password? Click here to reset