Optimization-based Causal Estimation from Heterogenous Environments

09/24/2021
by   Mingzhang Yin, et al.
5

This paper presents a new optimization approach to causal estimation. Given data that contains covariates and an outcome, which covariates are causes of the outcome, and what is the strength of the causality? In classical machine learning (ML), the goal of optimization is to maximize predictive accuracy. However, some covariates might exhibit a non-causal association to the outcome. Such spurious associations provide predictive power for classical ML, but they prevent us from causally interpreting the result. This paper proposes CoCo, an optimization algorithm that bridges the gap between pure prediction and causal inference. CoCo leverages the recently-proposed idea of environments, datasets of covariates/response where the causal relationships remain invariant but where the distribution of the covariates changes from environment to environment. Given datasets from multiple environments – and ones that exhibit sufficient heterogeneity – CoCo maximizes an objective for which the only solution is the causal solution. We describe the theoretical foundations of this approach and demonstrate its effectiveness on simulated and real datasets. Compared to classical ML and existing methods, CoCo provides more accurate estimates of the causal model.

READ FULL TEXT

page 21

page 23

research
04/05/2023

A step towards the applicability of algorithms based on invariant causal learning on observational data

Machine learning can benefit from causal discovery for interpretation an...
research
11/24/2020

Invariant Representation Learning for Treatment Effect Estimation

The defining challenge for causal inference from observational data is t...
research
05/17/2018

The Blessings of Multiple Causes

Causal inference from observation data often assumes "strong ignorabilit...
research
03/01/2019

Machine learning in policy evaluation: new tools for causal inference

While machine learning (ML) methods have received a lot of attention in ...
research
03/02/2023

Hyperparameter Tuning and Model Evaluation in Causal Effect Estimation

The performance of most causal effect estimators relies on accurate pred...
research
03/17/2022

Identifiability of Sparse Causal Effects using Instrumental Variables

Exogenous heterogeneity, for example, in the form of instrumental variab...
research
09/21/2023

Uplift vs. predictive modeling: a theoretical analysis

Despite the growing popularity of machine-learning techniques in decisio...

Please sign up or login with your details

Forgot password? Click here to reset