Domain Adaptation As a Problem of Inference on Graphical Models

02/09/2020
by   Kun Zhang, et al.
20

This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change across domains. To develop an automated way of domain adaptation with multiple source domains, we propose to use a graphical model as a compact way to encode the change property of the joint distribution, which can be learned from data, and then view domain adaptation as a problem of Bayesian inference on the graphical models. Such a graphical model distinguishes between constant and varied modules of the distribution and specifies the properties of the changes across domains, which serves as prior knowledge of the changing modules for the purpose of deriving the posterior of the target variable Y in the target domain. This provides an end-to-end framework of domain adaptation, in which additional knowledge about how the joint distribution changes, if available, can be directly incorporated to improve the graphical representation. We discuss how causality-based domain adaptation can be put under this umbrella. Experimental results on both synthetic and real data demonstrate the efficacy of the proposed framework for domain adaptation.

READ FULL TEXT
research
04/12/2018

Causal Generative Domain Adaptation Networks

We propose a new generative model for domain adaptation, in which traini...
research
07/18/2022

Multi-step domain adaptation by adversarial attack to ℋ Δℋ-divergence

Adversarial examples are transferable between different models. In our p...
research
08/02/2022

DAPDAG: Domain Adaptation via Perturbed DAG Reconstruction

Leveraging labelled data from multiple domains to enable prediction in a...
research
05/29/2018

AdapterNet - learning input transformation for domain adaptation

Deep neural networks have demonstrated impressive performance in various...
research
11/03/2020

Learning Causal Semantic Representation for Out-of-Distribution Prediction

Conventional supervised learning methods, especially deep ones, are foun...
research
04/27/2021

Graphical Modeling for Multi-Source Domain Adaptation

Multi-Source Domain Adaptation (MSDA) focuses on transferring the knowle...
research
11/22/2022

AdaptDHM: Adaptive Distribution Hierarchical Model for Multi-Domain CTR Prediction

Large-scale commercial platforms usually involve numerous business domai...

Please sign up or login with your details

Forgot password? Click here to reset