Randomization Tests for Weak Null Hypotheses

09/19/2018
by   Jason Wu, et al.
0

The Fisher randomization test (FRT) is applicable for any test statistic, under a sharp null hypothesis that can recover all missing potential outcomes. However, it is often of interest to test a weak null hypothesis that the treatment does not affect the units on average. To use the FRT for a weak null hypothesis, we must address two issues. First, we need to impute the missing potential outcomes although the weak null hypothesis cannot determine all of them. Second, we need to choose an appropriate test statistic. For a general weak null hypothesis, we propose an approach to imputing missing potential outcomes under a compatible sharp null hypothesis. With this imputation scheme, we advocate using a studentized statistic. The resulting FRT has multiple desirable features. First, it is model-free. Second, it is finite-sample exact under the sharp null hypothesis that we use to impute the potential outcomes. Third, it preserves correct large-sample type I errors under the weak null hypothesis of interest. Therefore, our FRT is agnostic to treatment effect heterogeneity. We establish a unified theory for general factorial experiments. We also extend it to stratified and clustered experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2020

Gaussian Prepivoting for Finite Population Causal Inference

In finite population causal inference exact randomization tests can be c...
research
10/27/2020

Covariate-adjusted Fisher randomization tests for the average treatment effect

Fisher's randomization test (FRT) delivers exact p-values under the stro...
research
01/22/2021

Randomization Inference beyond the Sharp Null: Bounded Null Hypotheses and Quantiles of Individual Treatment Effects

Randomization (a.k.a. permutation) inference is typically interpreted as...
research
04/22/2022

Sequential monitoring using the Second Generation P-Value with Type I error controlled by monitoring frequency

Many adaptive monitoring schemes adjust the required evidence toward a h...
research
10/24/2019

A Graph-Theoretic Approach to Randomization Tests of Causal Effects Under General Interference

Interference exists when a unit's outcome depends on another unit's trea...
research
03/20/2022

Improving Randomization Tests under Interference Based on Power Analysis

In causal inference, we can consider a situation in which treatment on o...
research
12/23/2019

Randomization Tests in Observational Studies with Staggered Adoption of Treatment

This paper studies inference in observational studies with time-varying ...

Please sign up or login with your details

Forgot password? Click here to reset