Optimizing the tie-breaker regression discontinuity design

08/22/2018
by   Art B. Owen, et al.
0

Motivated by customer loyalty plans, we study tie-breaker designs which are hybrids of randomized controlled trials (RCTs) and regression discontinuity designs (RDDs). We quantify the statistical efficiency of a tie-breaker design in which a proportion Δ of observed customers are in the RCT. In a two line regression, statistical efficiency increases monotonically with Δ, so efficiency is maximized by an RCT. That same regression model quantifies the short term value of the treatment allocation and this comparison favors smaller Δ with the RDD being best. We solve for the optimal tradeoff between these exploration and exploitation goals. The usual tie-breaker design experiments on the middle Δ subjects as ranked by the running variable. We quantify the efficiency of other designs such as experimenting only in the second decile from the top. We also consider more general models such as quadratic regressions.

READ FULL TEXT
research
02/25/2022

A general characterization of optimal tie-breaker designs

In a regression discontinuity design, subjects with a running variable x...
research
03/11/2019

Transparency and Control in Platforms for Networked Markets

In this work, we analyze the worst case efficiency loss of online platfo...
research
02/21/2022

Optimality in Multivariate Tie-breaker Designs

Tie-breaker designs (TBDs), in which subjects with extreme values are as...
research
01/23/2021

Local linear tie-breaker designs

Tie-breaker experimental designs are hybrids of Randomized Control Trial...
research
06/15/2022

Optimality of Matched-Pair Designs in Randomized Controlled Trials

In randomized controlled trials (RCTs), treatment is often assigned by s...
research
06/20/2022

Optimal design for on-farm strip trials – systematic or randomised?

There is no doubt on the importance of randomisation in agricultural exp...
research
03/24/2019

Correct power for cluster-randomized difference-in-difference trials with loss to follow-up

Cluster randomized trials with measurements at baseline can improve powe...

Please sign up or login with your details

Forgot password? Click here to reset