Domain Adaptation via Maximizing Surrogate Mutual Information

10/23/2021
by   Haiteng Zhao, et al.
0

Unsupervised domain adaptation (UDA), which is an important topic in transfer learning, aims to predict unlabeled data from target domain with access to labeled data from the source domain. In this work, we propose a novel framework called SIDA (Surrogate Mutual Information Maximization Domain Adaptation) with strong theoretical guarantees. To be specific, SIDA implements adaptation by maximizing mutual information (MI) between features. In the framework, a surrogate joint distribution models the underlying joint distribution of the unlabeled target domain. Our theoretical analysis validates SIDA by bounding the expected risk on target domain with MI and surrogate distribution bias. Experiments show that our approach is comparable with state-of-the-art unsupervised adaptation methods on standard UDA tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2019

Simplified Neural Unsupervised Domain Adaptation

Unsupervised domain adaptation (UDA) is the task of modifying a statisti...
research
12/15/2020

Hypothesis Disparity Regularized Mutual Information Maximization

We propose a hypothesis disparity regularized mutual information maximiz...
research
04/04/2023

Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptation

We use information-theoretic tools to derive a novel analysis of Multi-s...
research
01/09/2022

Preserving Domain Private Representation via Mutual Information Maximization

Recent advances in unsupervised domain adaptation have shown that mitiga...
research
05/10/2023

Best-Effort Adaptation

We study a problem of best-effort adaptation motivated by several applic...
research
06/29/2022

MaNi: Maximizing Mutual Information for Nuclei Cross-Domain Unsupervised Segmentation

In this work, we propose a mutual information (MI) based unsupervised do...
research
10/17/2019

Toward Subject Invariant and Class Disentangled Representation in BCI via Cross-Domain Mutual Information Estimator

In recent, deep learning-based feature representation methods have shown...

Please sign up or login with your details

Forgot password? Click here to reset