Meta-causal Learning for Single Domain Generalization

04/07/2023
by   Jin Chen, et al.
0

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to cover the target domains, but without estimating the domain shift between the source and target domains. In this paper, we propose a new learning paradigm, namely simulate-analyze-reduce, which first simulates the domain shift by building an auxiliary domain as the target domain, then learns to analyze the causes of domain shift, and finally learns to reduce the domain shift for model adaptation. Under this paradigm, we propose a meta-causal learning method to learn meta-knowledge, that is, how to infer the causes of domain shift between the auxiliary and source domains during training. We use the meta-knowledge to analyze the shift between the target and source domains during testing. Specifically, we perform multiple transformations on source data to generate the auxiliary domain, perform counterfactual inference to learn to discover the causal factors of the shift between the auxiliary and source domains, and incorporate the inferred causality into factor-aware domain alignments. Extensive experiments on several benchmarks of image classification show the effectiveness of our method.

READ FULL TEXT
research
10/08/2022

Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

In this paper, we tackle the problem of domain shift. Most existing meth...
research
08/31/2021

Self-balanced Learning For Domain Generalization

Domain generalization aims to learn a prediction model on multi-domain s...
research
10/09/2017

Deeper, Broader and Artier Domain Generalization

The problem of domain generalization is to learn from multiple training ...
research
02/10/2023

Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features

Conventional approaches to robustness try to learn a model based on caus...
research
01/31/2019

Feature-Critic Networks for Heterogeneous Domain Generalization

The well known domain shift issue causes model performance to degrade wh...
research
06/19/2022

Finding Diverse and Predictable Subgraphs for Graph Domain Generalization

This paper focuses on out-of-distribution generalization on graphs where...
research
05/26/2023

CNN Feature Map Augmentation for Single-Source Domain Generalization

In search of robust and generalizable machine learning models, Domain Ge...

Please sign up or login with your details

Forgot password? Click here to reset