Regression-adjusted average treatment effect estimates in stratified and sequentially randomized experiments

08/05/2019
by   Hanzhong Liu, et al.
0

Stratified and sequentially randomized experiments are widely used in fields such as agriculture, industry, medical science, economics, and finance. Baseline covariates are often collected for each unit in the experiments. Many researchers use linear regression to analyse the experimental results for improving efficiency of treatment effect estimation by adjusting the minor imbalances of covariates in the treatment and control group. Our work studies the asymptotic properties of regression adjustment in stratified and sequentially randomized experiments, under the randomization-based inference framework. We allow both the number of strata and their sizes to be arbitrary, provided the total number of experimental units tends to infinity and each stratum has at least two treated and two control units. Under slightly stronger but interpretable conditions, we re-establish the finite population central limit theory for a stratified random sample. Based on this theorem, we prove in our main results that, with certain other mild conditions, both the stratified difference-in-means and the regression-adjusted average treatment effect estimator are consistent and asymptotically normal. The asymptotic variance of the latter is no greater and is typically lesser than that of the former when the proportion of treated units is asymptotically the same across strata or the number of stratum is bounded. The magnitude of improvement depends on the extent to which the within-strata variation of the potential outcomes can be explained by the covariates. We also provide conservative variance estimators to construct large-sample confidence intervals for the average treatment effect, which are consistent if and only if the stratum-specific treatment effect is constant. Our theoretical results are confirmed by a simulation study and we conclude with an empirical illustration.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/10/2020

Rerandomization in stratified randomized experiments

Stratification and rerandomization are two well-known methods used in ra...
06/20/2018

Regression adjustment in randomized experiments with a diverging number of covariates

Extending R. A. Fisher and D. A. Freedman's results on the analysis of c...
11/08/2019

Balancing covariates in randomized experiments using the Gram-Schmidt walk

The paper introduces a class of experimental designs that allows experim...
04/18/2021

Least Squares with Error in Variables

Error-in-variables regression is a common ingredient in treatment effect...
08/31/2020

Design and Analysis of Switchback Experiments

In switchback experiments, a firm sequentially exposes an experimental u...
12/16/2020

No-harm calibration for generalized Oaxaca-Blinder estimators

In randomized experiments, linear regression with baseline features can ...
11/09/2019

Optimal Experimental Design for Staggered Rollouts

Experimentation has become an increasingly prevalent tool for guiding po...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.