The equivalence of the Delta method and the cluster-robust variance estimator for the analysis of clustered randomized experiments

by   Alex Deng, et al.

It often happens that the same problem presents itself to different communities and the solutions proposed or adopted by those communities are different. We take the case of the variance estimation of the population average treatment effect in cluster-randomized experiments. The econometrics literature promotes the cluster-robust variance estimator (Athey and Imbens, 2017), which can be dated back to the study of linear regression with clustered residuals (Liang and Zeger, 1986). The A/B testing or online experimentation literature promotes the delta method (Kohavi et al., 2010, Deng et al., 2017, 2018), which tackles the variance estimation of the ATE estimator directly using large sample theory. The two methods are seemly different as the former begins with a regression setting at the individual unit level and the latter is semi-parametric with only i.i.d. assumptions on the clusters. Both methods are widely used in practice. It begs the question for their connection and comparison. In this paper we prove they are equivalent and in the canonical implementation they should give exactly the same result.



There are no comments yet.


page 1

page 2

page 3

page 4


Designing Transportable Experiments

We consider the problem of designing a randomized experiment on a source...

Model-assisted analyses of cluster-randomized experiments

Cluster-randomized experiments are widely used due to their logistical c...

Estimation Methods for Cluster Randomized Trials with Noncompliance: A Study of A Biometric Smartcard Payment System in India

Many policy evaluations occur in settings with randomized assignment at ...

Design-Based Ratio Estimators for Clustered, Blocked RCTs

This article develops design-based ratio estimators for clustered, block...

A Comparison of Methods of Inference in Randomized Experiments from a Restricted Set of Allocations

Rerandomization is a strategy of increasing efficiency as compared to co...

On improving Neymanian analysis for 2^K factorial designs with binary outcomes

2^K factorial designs are widely adopted by statisticians and the broade...

Novel Non-Negative Variance Estimator for (Modified) Within-Cluster Resampling

This article proposes a novel variance estimator for within-cluster resa...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.