Domain-Adversarial Training of Neural Networks

05/28/2015
by   Yaroslav Ganin, et al.
0

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation suggesting that, for effective domain transfer to be achieved, predictions must be made based on features that cannot discriminate between the training (source) and test (target) domains. The approach implements this idea in the context of neural network architectures that are trained on labeled data from the source domain and unlabeled data from the target domain (no labeled target-domain data is necessary). As the training progresses, the approach promotes the emergence of features that are (i) discriminative for the main learning task on the source domain and (ii) indiscriminate with respect to the shift between the domains. We show that this adaptation behaviour can be achieved in almost any feed-forward model by augmenting it with few standard layers and a new gradient reversal layer. The resulting augmented architecture can be trained using standard backpropagation and stochastic gradient descent, and can thus be implemented with little effort using any of the deep learning packages. We demonstrate the success of our approach for two distinct classification problems (document sentiment analysis and image classification), where state-of-the-art domain adaptation performance on standard benchmarks is achieved. We also validate the approach for descriptor learning task in the context of person re-identification application.

READ FULL TEXT

page 14

page 21

page 27

09/26/2014

Unsupervised Domain Adaptation by Backpropagation

Top-performing deep architectures are trained on massive amounts of labe...
12/15/2014

Domain-Adversarial Neural Networks

We introduce a new representation learning algorithm suited to the conte...
05/26/2017

Multiple Source Domain Adaptation with Adversarial Training of Neural Networks

While domain adaptation has been actively researched in recent years, mo...
05/21/2016

Deep Transfer Learning with Joint Adaptation Networks

Deep networks have been successfully applied to learn transferable featu...
07/31/2022

Feather-Light Fourier Domain Adaptation in Magnetic Resonance Imaging

Generalizability of deep learning models may be severely affected by the...
02/25/2020

Diversity-Based Generalization for Neural Unsupervised Text Classification under Domain Shift

Domain adaptation approaches seek to learn from a source domain and gene...
05/16/2019

Gated Convolutional Neural Networks for Domain Adaptation

Domain Adaptation explores the idea of how to maximize performance on a ...

Code Repositories

adda_mnist64

Adversarial Discriminative Domain Adaptation with MNIST 64x64 in Lasagne-Theano


view repo