Causal isotonic calibration for heterogeneous treatment effects

02/27/2023
by   Lars van der Laan, et al.
0

We propose causal isotonic calibration, a novel nonparametric method for calibrating predictors of heterogeneous treatment effects. In addition, we introduce a novel data-efficient variant of calibration that avoids the need for hold-out calibration sets, which we refer to as cross-calibration. Causal isotonic cross-calibration takes cross-fitted predictors and outputs a single calibrated predictor obtained using all available data. We establish under weak conditions that causal isotonic calibration and cross-calibration both achieve fast doubly-robust calibration rates so long as either the propensity score or outcome regression is estimated well in an appropriate sense. The proposed causal isotonic calibrator can be wrapped around any black-box learning algorithm to provide strong distribution-free calibration guarantees while preserving predictive performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/20/2022

On Calibration of Ensemble-Based Credal Predictors

In recent years, several classification methods that intend to quantify ...
research
03/24/2022

Calibration Error for Heterogeneous Treatment Effects

Recently, many researchers have advanced data-driven methods for modelin...
research
08/23/2020

Stable discovery of interpretable subgroups via calibration in causal studies

Building on Yu and Kumbier's PCS framework and for randomized experiment...
research
02/21/2023

A Unifying Perspective on Multi-Calibration: Unleashing Game Dynamics for Multi-Objective Learning

We provide a unifying framework for the design and analysis of multi-cal...
research
11/04/2021

Scaffolding Sets

Predictors map individual instances in a population to the interval [0,1...
research
12/22/2017

Obtaining Accurate Probabilistic Causal Inference by Post-Processing Calibration

Discovery of an accurate causal Bayesian network structure from observat...
research
10/06/2022

Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Prediction

Conventional frequentist learning is known to yield poorly calibrated mo...

Please sign up or login with your details

Forgot password? Click here to reset