Learning causal representations for robust domain adaptation

11/12/2020
by   Shuai Yang, et al.
5

Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily require large amounts of unlabeled target domain data for learning domain invariant representations to achieve good generalizability on the target domain. In fact, in many real-world applications, target domain data may not always be available. In this paper, we study the cases where at the training phase the target domain data is unavailable and only well-labeled source domain data is available, called robust domain adaptation. To tackle this problem, under the assumption that causal relationships between features and the class variable are robust across domains, we propose a novel Causal AutoEncoder (CAE), which integrates deep autoencoder and causal structure learning into a unified model to learn causal representations only using data from a single source domain. Specifically, a deep autoencoder model is adopted to learn low-dimensional representations, and a causal structure learning model is designed to separate the low-dimensional representations into two groups: causal representations and task-irrelevant representations. Using three real-world datasets the extensive experiments have validated the effectiveness of CAE compared to eleven state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2019

Deep causal representation learning for unsupervised domain adaptation

Studies show that the representations learned by deep neural networks ca...
research
10/05/2016

EPOpt: Learning Robust Neural Network Policies Using Model Ensembles

Sample complexity and safety are major challenges when learning policies...
research
08/24/2019

Population-aware Hierarchical Bayesian Domain Adaptation via Multiple-component Invariant Learning

Observational transport relates to transferring a statistical relation R...
research
02/11/2021

Selecting Treatment Effects Models for Domain Adaptation Using Causal Knowledge

Selecting causal inference models for estimating individualized treatmen...
research
07/23/2021

Transporting Causal Mechanisms for Unsupervised Domain Adaptation

Existing Unsupervised Domain Adaptation (UDA) literature adopts the cova...
research
06/01/2023

Maximal Domain Independent Representations Improve Transfer Learning

Domain adaptation (DA) adapts a training dataset from a source domain fo...
research
03/25/2021

Self-Labeling of Fully Mediating Representations by Graph Alignment

To be able to predict a molecular graph structure (W) given a 2D image o...

Please sign up or login with your details

Forgot password? Click here to reset