Meta-Causal Feature Learning for Out-of-Distribution Generalization

08/22/2022
by   Yuqing Wang, et al.
0

Causal inference has become a powerful tool to handle the out-of-distribution (OOD) generalization problem, which aims to extract the invariant features. However, conventional methods apply causal learners from multiple data splits, which may incur biased representation learning from imbalanced data distributions and difficulty in invariant feature learning from heterogeneous sources. To address these issues, this paper presents a balanced meta-causal learner (BMCL), which includes a balanced task generation module (BTG) and a meta-causal feature learning module (MCFL). Specifically, the BTG module learns to generate balanced subsets by a self-learned partitioning algorithm with constraints on the proportions of sample classes and contexts. The MCFL module trains a meta-learner adapted to different distributions. Experiments conducted on NICO++ dataset verified that BMCL effectively identifies the class-invariant visual regions for classification and may serve as a general framework to improve the performance of the state-of-the-art methods.

READ FULL TEXT
research
03/12/2023

RotoGBML: Towards Out-of-Distribution Generalization for Gradient-Based Meta-Learning

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to...
research
08/08/2020

Meta Feature Modulator for Long-tailed Recognition

Deep neural networks often degrade significantly when training data suff...
research
03/11/2021

Causal Learner: A Toolbox for Causal Structure and Markov Blanket Learning

Causal Learner is a toolbox for learning causal structure and Markov bla...
research
11/26/2021

Confounder Identification-free Causal Visual Feature Learning

Confounders in deep learning are in general detrimental to model's gener...
research
05/18/2020

Causal Feature Learning for Utility-Maximizing Agents

Discovering high-level causal relations from low-level data is an import...
research
04/17/2022

Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition

Subject-invariant facial action unit (AU) recognition remains challengin...
research
08/19/2021

Causal Attention for Unbiased Visual Recognition

Attention module does not always help deep models learn causal features ...

Please sign up or login with your details

Forgot password? Click here to reset