Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules

04/26/2021
by   Yusuke Narita, et al.
0

Algorithms produce a growing portion of decisions and recommendations both in policy and business. Such algorithmic decisions are natural experiments (conditionally quasi-randomly assigned instruments) since the algorithms make decisions based only on observable input variables. We use this observation to develop a treatment-effect estimator for a class of stochastic and deterministic algorithms. Our estimator is shown to be consistent and asymptotically normal for well-defined causal effects. A key special case of our estimator is a high-dimensional regression discontinuity design. The proofs use tools from differential geometry and geometric measure theory, which may be of independent interest. The practical performance of our method is first demonstrated in a high-dimensional simulation resembling decision-making by machine learning algorithms. Our estimator has smaller mean squared errors compared to alternative estimators. We finally apply our estimator to evaluate the effect of Coronavirus Aid, Relief, and Economic Security (CARES) Act, where more than $10 billion worth of relief funding is allocated to hospitals via an algorithmic rule. The estimates suggest that the relief funding has little effects on COVID-19-related hospital activity levels. Naive OLS and IV estimates exhibit substantial selection bias.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2020

Endogenous Treatment Effect Estimation with some Invalid and Irrelevant Instruments

Instrumental variables (IV) regression is a popular method for the estim...
research
02/11/2023

Sequential Underspecified Instrument Selection for Cause-Effect Estimation

Instrumental variable (IV) methods are used to estimate causal effects i...
research
01/11/2018

Sharp instruments for classifying compliers and generalizing causal effects

It is well-known that, without restricting treatment effect heterogeneit...
research
11/21/2019

Regression Discontinuity Design under Self-selection

In Regression Discontinuity (RD) design, self-selection leads to differe...
research
05/04/2023

Correcting for Interference in Experiments: A Case Study at Douyin

Interference is a ubiquitous problem in experiments conducted on two-sid...
research
04/08/2020

Manipulation-Proof Machine Learning

An increasing number of decisions are guided by machine learning algorit...
research
12/31/2020

Breaking Ties: Regression Discontinuity Design Meets Market Design

Many schools in large urban districts have more applicants than seats. C...

Please sign up or login with your details

Forgot password? Click here to reset