Learning Independent Causal Mechanisms

Independent causal mechanisms are a central concept in the study of causality with implications for machine learning tasks. In this work we develop an algorithm to recover a set of (inverse) independent mechanisms relating a distribution transformed by the mechanisms to a reference distribution. The approach is fully unsupervised and based on a set of experts that compete for data to specialize and extract the mechanisms. We test and analyze the proposed method on a series of experiments based on image transformations. Each expert successfully maps a subset of the transformed data to the original domain, and the learned mechanisms generalize to other domains. We discuss implications for domain transfer and links to recent trends in generative modeling.

READ FULL TEXT
research
06/05/2023

Learning Causal Mechanisms through Orthogonal Neural Networks

A fundamental feature of human intelligence is the ability to infer high...
research
03/27/2022

Causality Inspired Representation Learning for Domain Generalization

Domain generalization (DG) is essentially an out-of-distribution problem...
research
02/01/2023

A Survey of Methods, Challenges and Perspectives in Causality

The Causality field aims to find systematic methods for uncovering cause...
research
04/01/2020

A theory of independent mechanisms for extrapolation in generative models

Deep generative models reproduce complex empirical data but cannot extra...
research
03/22/2022

Out-of-distribution Generalization with Causal Invariant Transformations

In real-world applications, it is important and desirable to learn a mod...
research
02/18/2018

Ab initio Algorithmic Causal Deconvolution of Intertwined Programs and Networks by Generative Mechanism

To extract and learn representations leading to generative mechanisms fr...
research
03/16/2022

Counterfactual Inference of Second Opinions

Automated decision support systems that are able to infer second opinion...

Please sign up or login with your details

Forgot password? Click here to reset