Double/Debiased Machine Learning for Treatment and Causal Parameters

07/30/2016
by   Victor Chernozhukov, et al.
0

Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, average treatment effects, average lifts, and demand or supply elasticities. In fact, estimates of such causal parameters obtained via naively plugging ML estimators into estimating equations for such parameters can behave very poorly due to the regularization bias. Fortunately, this regularization bias can be removed by solving auxiliary prediction problems via ML tools. Specifically, we can form an orthogonal score for the target low-dimensional parameter by combining auxiliary and main ML predictions. The score is then used to build a de-biased estimator of the target parameter which typically will converge at the fastest possible 1/root(n) rate and be approximately unbiased and normal, and from which valid confidence intervals for these parameters of interest may be constructed. The resulting method thus could be called a "double ML" method because it relies on estimating primary and auxiliary predictive models. In order to avoid overfitting, our construction also makes use of the K-fold sample splitting, which we call cross-fitting. This allows us to use a very broad set of ML predictive methods in solving the auxiliary and main prediction problems, such as random forest, lasso, ridge, deep neural nets, boosted trees, as well as various hybrids and aggregators of these methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/28/2017

Orthogonal Machine Learning for Demand Estimation: High Dimensional Causal Inference in Dynamic Panels

There has been growing interest in how economists can import machine lea...
research
06/14/2023

Kernel Debiased Plug-in Estimation

We consider the problem of estimating a scalar target parameter in the p...
research
06/03/2022

Debiased Machine Learning without Sample-Splitting for Stable Estimators

Estimation and inference on causal parameters is typically reduced to a ...
research
02/23/2018

Double/De-Biased Machine Learning Using Regularized Riesz Representers

We provide adaptive inference methods for linear functionals of sparse l...
research
07/21/2023

Improving Accuracy in Cell-Perturbation Experiments by Leveraging Auxiliary Information

Modern cell-perturbation experiments expose cells to panels of hundreds ...
research
12/30/2016

Counterfactual Prediction with Deep Instrumental Variables Networks

We are in the middle of a remarkable rise in the use and capability of a...
research
03/11/2020

Auditing ML Models for Individual Bias and Unfairness

We consider the task of auditing ML models for individual bias/unfairnes...

Please sign up or login with your details

Forgot password? Click here to reset