Unsupervised Visual Domain Adaptation: A Deep Max-Margin Gaussian Process Approach

by   Minyoung Kim, et al.

In unsupervised domain adaptation, it is widely known that the target domain error can be provably reduced by having a shared input representation that makes the source and target domains indistinguishable from each other. Very recently it has been studied that not just matching the marginal input distributions, but the alignment of output (class) distributions is also critical. The latter can be achieved by minimizing the maximum discrepancy of predictors (classifiers). In this paper, we adopt this principle, but propose a more systematic and effective way to achieve hypothesis consistency via Gaussian processes (GP). The GP allows us to define/induce a hypothesis space of the classifiers from the posterior distribution of the latent random functions, turning the learning into a simple large-margin posterior separation problem, far easier to solve than previous approaches based on adversarial minimax optimization. We formulate a learning objective that effectively pushes the posterior to minimize the maximum discrepancy. This is further shown to be equivalent to maximizing margins and minimizing uncertainty of the class predictions in the target domain, a well-established principle in classical (semi-)supervised learning. Empirical results demonstrate that our approach is comparable or superior to the existing methods on several benchmark domain adaptation datasets.


page 7

page 10

page 14


Unsupervised Domain Adaptation Based on the Predictive Uncertainty of Models

Unsupervised domain adaptation (UDA) aims to improve the prediction perf...

Using Latent Codes for Class Imbalance Problem in Unsupervised Domain Adaptation

We address the problem of severe class imbalance in unsupervised domain ...

Domain Adaptation by Class Centroid Matching and Local Manifold Self-Learning

Domain adaptation has been a fundamental technology for transferring kno...

Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation

Although unsupervised domain adaptation methods have been widely adopted...

Domain Generalisation via Domain Adaptation: An Adversarial Fourier Amplitude Approach

We tackle the domain generalisation (DG) problem by posing it as a domai...

Unsupervised Domain Adaptation for Graph-Structured Data Using Class-Conditional Distribution Alignment

Adopting deep learning models for graph-structured data is challenging d...

Learning Smooth Representation for Unsupervised Domain Adaptation

In unsupervised domain adaptation, existing methods utilizing the bounda...

Please sign up or login with your details

Forgot password? Click here to reset