Randomization Bias in Field Trials to Evaluate Targeting Methods

11/21/2017
by   Eric Potash, et al.
The University of Chicago
0

This paper studies the evaluation of methods for targeting the allocation of limited resources to a high-risk subpopulation. We consider a randomized controlled trial to measure the difference in efficiency between two targeting methods and show that it is biased. An alternative, survey-based design is shown to be unbiased. Both designs are simulated for the evaluation of a policy to target food safety inspections using a predictive model. Our work anticipates further developments in economics that will be important as predictive modeling becomes an increasingly common policy tool.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/15/2019

Defining mediation effects for multiple mediators using the concept of the target randomized trial

Causal mediation approaches have been primarily developed for the goal o...
10/01/2019

Affordable Uplift: Supervised Randomization in Controlled Experiments

Customer scoring models are the core of scalable direct marketing. Uplif...
02/06/2023

Improved Policy Evaluation for Randomized Trials of Algorithmic Resource Allocation

We consider the task of evaluating policies of algorithmic resource allo...
06/15/2018

Imbalanced Randomization in Non-Inferiority Trial

Randomization is a common technique used in clinical trials to eliminate...
03/10/2021

Optimal Targeting in Fundraising: A Machine Learning Approach

Ineffective fundraising lowers the resources charities can use for goods...
02/13/2020

Experimental Design in Two-Sided Platforms: An Analysis of Bias

We develop an analytical framework to study experimental design in two-s...
07/09/2018

Bias Correction For Paid Search In Media Mix Modeling

Evaluating the return on ad spend (ROAS), the causal effect of advertisi...

Please sign up or login with your details

Forgot password? Click here to reset