Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performance

01/30/2022
by   Gabriel Okasa, et al.
0

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous treatment effects under the usage of sample-splitting and cross-fitting to reduce the overfitting bias. In both synthetic and semi-synthetic simulations we find that the performance of the meta-learners in finite samples greatly depends on the estimation procedure. The results imply that sample-splitting and cross-fitting are beneficial in large samples for bias reduction and efficiency of the meta-learners, respectively, whereas full-sample estimation is preferable in small samples. Furthermore, we derive practical recommendations for application of specific meta-learners in empirical studies depending on particular data characteristics such as treatment shares and sample size.

READ FULL TEXT

page 39

page 40

page 41

page 42

research
07/06/2020

Cross-Fitting and Averaging for Machine Learning Estimation of Heterogeneous Treatment Effects

We investigate the finite sample performance of sample splitting, cross-...
research
01/26/2021

Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithms

The need to evaluate treatment effectiveness is ubiquitous in most of em...
research
11/30/2020

Double machine learning for sample selection models

This paper considers treatment evaluation when outcomes are only observe...
research
02/12/2020

To Split or Not to Split: The Impact of Disparate Treatment in Classification

Disparate treatment occurs when a machine learning model produces differ...
research
08/28/2023

Conformal Meta-learners for Predictive Inference of Individual Treatment Effects

We investigate the problem of machine learning-based (ML) predictive inf...
research
04/30/2021

Automatic Debiased Machine Learning via Neural Nets for Generalized Linear Regression

We give debiased machine learners of parameters of interest that depend ...

Please sign up or login with your details

Forgot password? Click here to reset