Sensitivity Analysis of Individual Treatment Effects: A Robust Conformal Inference Approach

11/23/2021
by   Ying Jin, et al.
0

We propose a model-free framework for sensitivity analysis of individual treatment effects (ITEs), building upon ideas from conformal inference. For any unit, our procedure reports the Γ-value, a number which quantifies the minimum strength of confounding needed to explain away the evidence for ITE. Our approach rests on the reliable predictive inference of counterfactuals and ITEs in situations where the training data is confounded. Under the marginal sensitivity model of Tan (2006), we characterize the shift between the distribution of the observations and that of the counterfactuals. We first develop a general method for predictive inference of test samples from a shifted distribution; we then leverage this to construct covariate-dependent prediction sets for counterfactuals. No matter the value of the shift, these prediction sets (resp. approximately) achieve marginal coverage if the propensity score is known exactly (resp. estimated). We describe a distinct procedure also attaining coverage, however, conditional on the training data. In the latter case, we prove a sharpness result showing that for certain classes of prediction problems, the prediction intervals cannot possibly be tightened. We verify the validity and performance of the new methods via simulation studies and apply them to analyze real datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/07/2022

Training-conditional coverage for distribution-free predictive inference

The field of distribution-free predictive inference provides tools for p...
research
03/03/2022

Doubly Robust Calibration of Prediction Sets under Covariate Shift

Conformal prediction has received tremendous attention in recent years a...
research
07/18/2023

Model-free selective inference under covariate shift via weighted conformal p-values

This paper introduces weighted conformal p-values for model-free selecti...
research
06/14/2022

Probabilistic Conformal Prediction Using Conditional Random Samples

This paper proposes probabilistic conformal prediction (PCP), a predicti...
research
08/10/2020

Robust Validation: Confident Predictions Even When Distributions Shift

While the traditional viewpoint in machine learning and statistics assum...
research
06/01/2021

Adaptive Conformal Inference Under Distribution Shift

We develop methods for forming prediction sets in an online setting wher...
research
03/17/2021

Conformalized Survival Analysis

Existing survival analysis techniques heavily rely on strong modelling a...

Please sign up or login with your details

Forgot password? Click here to reset