Identifying Causal Effect Inference Failure with Uncertainty-Aware Models

07/01/2020
by   Andrew Jesson, et al.
5

Recommending the best course of action for an individual is a major application of individual-level causal effect estimation. This application is often needed in safety-critical domains such as healthcare, where estimating and communicating uncertainty to decision-makers is crucial. We introduce a practical approach for integrating uncertainty estimation into a class of state-of-the-art neural network methods used for individual-level causal estimates. We show that our methods enable us to deal gracefully with situations of "no-overlap", common in high-dimensional data, where standard applications of causal effect approaches fail. Further, our methods allow us to handle covariate shift, where test distribution differs to train distribution, common when systems are deployed in practice. We show that when such a covariate shift occurs, correctly modeling uncertainty can keep us from giving overconfident and potentially harmful recommendations. We demonstrate our methodology with a range of state-of-the-art models. Under both covariate shift and lack of overlap, our uncertainty-equipped methods can alert decisions makers when predictions are not to be trusted while outperforming their uncertainty-oblivious counterparts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2023

To Predict or to Reject: Causal Effect Estimation with Uncertainty on Networked Data

Due to the imbalanced nature of networked observational data, the causal...
research
10/19/2021

Addressing Positivity Violations in Causal Effect Estimation using Gaussian Process Priors

In observational studies, causal inference relies on several key identif...
research
12/06/2022

A Learning Based Hypothesis Test for Harmful Covariate Shift

The ability to quickly and accurately identify covariate shift at test t...
research
09/17/2022

Mitigating Both Covariate and Conditional Shift for Domain Generalization

Domain generalization (DG) aims to learn a model on several source domai...
research
06/21/2021

Stratified Learning: a general-purpose statistical method for improved learning under Covariate Shift

Covariate shift arises when the labelled training (source) data is not r...
research
11/07/2017

Overlap in Observational Studies with High-Dimensional Covariates

Causal inference in observational settings typically rests on a pair of ...
research
05/16/2023

Transfer Causal Learning: Causal Effect Estimation with Knowledge Transfer

A novel problem of improving causal effect estimation accuracy with the ...

Please sign up or login with your details

Forgot password? Click here to reset