From Local to Global: External Validity in a Fertility Natural Experiment

06/19/2019
by   Rajeev Dehejia, et al.
0

We study issues related to external validity for treatment effects using over 100 replications of the Angrist and Evans (1998) natural experiment on the effects of sibling sex composition on fertility and labor supply. The replications are based on census data from around the world going back to 1960. We decompose sources of error in predicting treatment effects in external contexts in terms of macro and micro sources of variation. In our empirical setting, we find that macro covariates dominate over micro covariates for reducing errors in predicting treatments, an issue that past studies of external validity have been unable to evaluate. We develop methods for two applications to evidence-based decision-making, including determining where to locate an experiment and whether policy-makers should commission new experiments or rely on an existing evidence base for making a policy decision.

READ FULL TEXT

Authors

02/23/2021

A Review of Generalizability and Transportability

When assessing causal effects, determining the target population to whic...
05/18/2020

Compounding Injustice: History and Prediction in Carceral Decision-Making

Risk assessment algorithms in criminal justice put people's lives at the...
12/16/2021

Reinforcing RCTs with Multiple Priors while Learning about External Validity

This paper presents a framework for how to incorporate prior sources of ...
12/25/2015

Multi-Level Cause-Effect Systems

We present a domain-general account of causation that applies to setting...
02/01/2020

Natural Experiments

The term natural experiment is used inconsistently. In one interpretatio...
10/07/2017

Ranking and Selection with Covariates for Personalized Decision Making

We consider a ranking and selection problem in the context of personaliz...
04/21/2021

Calibrated Optimal Decision Making with Multiple Data Sources and Limited Outcome

We consider the optimal decision-making problem in a primary sample of i...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.