Consistency of invariance-based randomization tests

04/25/2021
by   Edgar Dobriban, et al.
0

Invariance-based randomization tests – such as permutation tests – are an important and widely used class of statistical methods. They allow drawing inferences with few assumptions on the data distribution. Most work focuses on their type I error control properties, while their consistency properties are much less understood. We develop a general framework and a set of results on the consistency of invariance-based randomization tests in signal-plus-noise models. Our framework is grounded in the deep mathematical area of representation theory. We allow the transforms to be general compact topological groups, such as rotation groups. Moreover, we allow actions by general linear group representations. We apply our framework to a number of fundamental and highly important problems in statistics, including sparse vector detection, testing for low-rank matrices in noise, sparse detection in linear regression, symmetric submatrix detection, and two-sample testing. Perhaps surprisingly, we find that randomization tests can adapt to problem structure and detect signals at the same rate as tests with full knowledge of the noise distribution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2022

Asymptotic Invariance and Robustness of Randomization Tests

Proper testing of hypotheses requires adherence to the relevant assumpti...
research
12/05/2019

Another look at the Lady Tasting Tea and permutation-based randomization tests

Fisher's famous Lady Tasting Tea experiment is often referred to as the ...
research
04/21/2021

Multiple conditional randomization tests

We propose a general framework for (multiple) conditional randomization ...
research
03/21/2022

What is a randomization test?

The meaning of randomization tests has become obscure in statistics educ...
research
08/24/2020

Efficient Detection Of Infected Individuals using Two Stage Testing

Group testing is an efficient method for testing a large population to d...
research
11/13/2019

Randomization tests of copula symmetry

New nonparametric tests of copula exchangeability and radial symmetry ar...
research
01/12/2018

TFisher Tests: Optimal and Adaptive Thresholding for Combining p-Values

For testing a group of hypotheses, tremendous p-value combination method...

Please sign up or login with your details

Forgot password? Click here to reset