Variance Minimization in the Wasserstein Space for Invariant Causal Prediction

10/13/2021
by   Guillaume Martinet, et al.
0

Selecting powerful predictors for an outcome is a cornerstone task for machine learning. However, some types of questions can only be answered by identifying the predictors that causally affect the outcome. A recent approach to this causal inference problem leverages the invariance property of a causal mechanism across differing experimental environments (Peters et al., 2016; Heinze-Deml et al., 2018). This method, invariant causal prediction (ICP), has a substantial computational defect – the runtime scales exponentially with the number of possible causal variables. In this work, we show that the approach taken in ICP may be reformulated as a series of nonparametric tests that scales linearly in the number of predictors. Each of these tests relies on the minimization of a novel loss function – the Wasserstein variance – that is derived from tools in optimal transport theory and is used to quantify distributional variability across environments. We prove under mild assumptions that our method is able to recover the set of identifiable direct causes, and we demonstrate in our experiments that it is competitive with other benchmark causal discovery algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2020

Invariant Risk Minimization Games

The standard risk minimization paradigm of machine learning is brittle w...
research
07/15/2023

Identifying Direct Causes using Intervened Target Variable

Identifying the direct causes or causal parents of a target variable is ...
research
08/16/2018

Switching Regression Models and Causal Inference in the Presence of Latent Variables

Given a response Y and a vector X = (X^1, ..., X^d) of d predictors, we ...
research
11/16/2022

Identifying the Causes of Pyrocumulonimbus (PyroCb)

A first causal discovery analysis from observational data of pyroCb (sto...
research
07/29/2022

The Generalized Causal Dantzig: A Unified Approach to Instruments and Environments

Many recent works have proposed regression models which are invariant ac...
research
02/21/2020

Directed Acyclic Graphs and causal thinking in clinical risk prediction modeling

Background: In epidemiology, causal inference and prediction modeling me...
research
05/26/2017

Learning Causal Structures Using Regression Invariance

We study causal inference in a multi-environment setting, in which the f...

Please sign up or login with your details

Forgot password? Click here to reset