Covariate-adjusted Fisher randomization tests for the average treatment effect

10/27/2020
by   Anqi Zhao, et al.
0

Fisher's randomization test (FRT) delivers exact p-values under the strong null hypothesis of no treatment effect on any units whatsoever and allows for flexible covariate adjustment to improve the power. Of interest is whether the procedure could also be valid for testing the weak null hypothesis of zero average treatment effect. Towards this end, we evaluate two general strategies for FRT with covariate-adjusted test statistics: that based on the residuals from an outcome model with only the covariates, and that based on the output from an outcome model with both the treatment and the covariates. Based on theory and simulation, we recommend using the ordinary least squares (OLS) fit of the observed outcome on the treatment, centered covariates, and their interactions for covariate adjustment, and conducting FRT with the robust t-value of the treatment as the test statistic. The resulting FRT is finite-sample exact for the strong null hypothesis, asymptotically valid for the weak null hypothesis, and more powerful than the unadjusted analog under alternatives, all irrespective of whether the linear model is correctly specified or not. We develop the theory for complete randomization, cluster randomization, stratified randomization, and rerandomization, respectively, and give a recommendation for the test procedure and test statistic under each design. We first focus on the finite-population perspective and then extend the result to the super-population perspective, highlighting the difference in standard errors. Motivated by the similarity in procedure, we also evaluate the design-based properties of five existing permutation tests originally for linear models and show the superiority of the proposed FRT for testing the treatment effects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2018

Randomization Tests for Weak Null Hypotheses

The Fisher randomization test (FRT) is applicable for any test statistic...
research
01/22/2021

Randomization Inference beyond the Sharp Null: Bounded Null Hypotheses and Quantiles of Individual Treatment Effects

Randomization (a.k.a. permutation) inference is typically interpreted as...
research
07/06/2021

Randomization-based Test for Censored Outcomes: A New Look at the Logrank Test

Two-sample tests have been one of the most classical topics in statistic...
research
02/24/2023

Permutation tests for assessing potential non-linear associations between treatment use and multivariate clinical outcomes

In many psychometric applications, the relationship between the mean of ...
research
04/24/2020

The Generalized Oaxaca-Blinder Estimator

After performing a randomized experiment, researchers often use ordinary...
research
09/23/2020

A projection-based model checking for heterogeneous treatment effect

In this paper, we investigate the hypothesis testing problem that checks...
research
04/17/2023

Adjustment with Many Regressors Under Covariate-Adaptive Randomizations

Our paper identifies a trade-off when using regression adjustments (RAs)...

Please sign up or login with your details

Forgot password? Click here to reset