Invariant Causal Mechanisms through Distribution Matching

06/23/2022
by   Mathieu Chevalley, et al.
0

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which recently received a lot of attention is described by the notion of invariance. In this work we provide a causal perspective and new algorithm for learning invariant representations. Empirically we show that this algorithm works well on a diverse set of tasks and in particular we observe state-of-the-art performance on domain generalization, where we are able to significantly boost the score of existing models.

READ FULL TEXT

page 4

page 15

research
06/02/2021

Contrastive ACE: Domain Generalization Through Alignment of Causal Mechanisms

Domain generalization aims to learn knowledge invariant across different...
research
01/14/2023

Generalized Invariant Matching Property via LASSO

Learning under distribution shifts is a challenging task. One principled...
research
11/29/2021

Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective

Learning behavioral patterns from observational data has been a de-facto...
research
10/15/2020

Representation Learning via Invariant Causal Mechanisms

Self-supervised learning has emerged as a strategy to reduce the relianc...
research
06/12/2020

Domain Generalization using Causal Matching

Learning invariant representations has been proposed as a key technique ...
research
09/18/2023

Causal Theories and Structural Data Representations for Improving Out-of-Distribution Classification

We consider how human-centered causal theories and tools from the dynami...
research
05/30/2022

PAC Generalization via Invariant Representations

One method for obtaining generalizable solutions to machine learning tas...

Please sign up or login with your details

Forgot password? Click here to reset