DeepAI AI Chat
Log In Sign Up

Maximizing Conditional Independence for Unsupervised Domain Adaptation

by   Yi-Ming Zhai, et al.

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributions of the source and target domains, which probably lead a misalignment of samples from the same class but different domains. In this paper, we deal with this misalignment by achieving the class-conditioned transferring from a new perspective. We aim to maximize the conditional independence of feature and domain given class in the reproducing kernel Hilbert space. The optimization of the conditional independence measure can be viewed as minimizing a surrogate of a certain mutual information between feature and domain. An interpretable empirical estimation of the conditional dependence is deduced and connected with the unconditional case. Besides, we provide an upper bound on the target error by taking the class-conditional distribution into account, which provides a new theoretical insight for most class-conditioned transferring methods. In addition to unsupervised domain adaptation, we extend our method to the multi-source scenario in a natural and elegant way. Extensive experiments on four benchmarks validate the effectiveness of the proposed models in both unsupervised domain adaptation and multiple source domain adaptation.


page 1

page 6


Domain Adaptation and Image Classification via Deep Conditional Adaptation Network

Unsupervised domain adaptation aims to generalize the supervised model t...

A General Upper Bound for Unsupervised Domain Adaptation

In this work, we present a novel upper bound of target error to address ...

Conditional Bures Metric for Domain Adaptation

As a vital problem in classification-oriented transfer, unsupervised dom...

Principled Hybrids of Generative and Discriminative Domain Adaptation

We propose a probabilistic framework for domain adaptation that blends b...

Aggregating From Multiple Target-Shifted Sources

Multi-source domain adaptation aims at leveraging the knowledge from mul...

Towards Unsupervised Domain Adaptation via Domain-Transformer

As a vital problem in pattern analysis and machine intelligence, Unsuper...

A Comparative Study on Unsupervised Domain Adaptation Approaches for Coffee Crop Mapping

In this work, we investigate the application of existing unsupervised do...