The equivalence of the Delta method and the cluster-robust variance estimator for the analysis of clustered randomized experiments

05/31/2021
by   Alex Deng, et al.
0

It often happens that the same problem presents itself to different communities and the solutions proposed or adopted by those communities are different. We take the case of the variance estimation of the population average treatment effect in cluster-randomized experiments. The econometrics literature promotes the cluster-robust variance estimator (Athey and Imbens, 2017), which can be dated back to the study of linear regression with clustered residuals (Liang and Zeger, 1986). The A/B testing or online experimentation literature promotes the delta method (Kohavi et al., 2010, Deng et al., 2017, 2018), which tackles the variance estimation of the ATE estimator directly using large sample theory. The two methods are seemly different as the former begins with a regression setting at the individual unit level and the latter is semi-parametric with only i.i.d. assumptions on the clusters. Both methods are widely used in practice. It begs the question for their connection and comparison. In this paper we prove they are equivalent and in the canonical implementation they should give exactly the same result.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

09/08/2020

Designing Transportable Experiments

We consider the problem of designing a randomized experiment on a source...
04/09/2021

Model-assisted analyses of cluster-randomized experiments

Cluster-randomized experiments are widely used due to their logistical c...
05/09/2018

Estimation Methods for Cluster Randomized Trials with Noncompliance: A Study of A Biometric Smartcard Payment System in India

Many policy evaluations occur in settings with randomized assignment at ...
02/04/2020

Design-Based Ratio Estimators for Clustered, Blocked RCTs

This article develops design-based ratio estimators for clustered, block...
11/06/2019

A Comparison of Methods of Inference in Randomized Experiments from a Restricted Set of Allocations

Rerandomization is a strategy of increasing efficiency as compared to co...
03/12/2018

On improving Neymanian analysis for 2^K factorial designs with binary outcomes

2^K factorial designs are widely adopted by statisticians and the broade...
11/28/2019

Novel Non-Negative Variance Estimator for (Modified) Within-Cluster Resampling

This article proposes a novel variance estimator for within-cluster resa...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.