Permutation Tests at Nonparametric Rates

02/26/2021
by   Marinho Bertanha, et al.
0

Classical two-sample permutation tests for equality of distributions have exact size in finite samples, but they fail to control size for testing equality of parameters that summarize each distribution. This paper proposes permutation tests for equality of parameters that are estimated at root-n or slower rates. Our general framework applies to both parametric and nonparametric models, with two samples or one sample split into two subsamples. Our tests have correct size asymptotically while preserving exact size in finite samples when distributions are equal. They have no loss in local-asymptotic power compared to tests that use asymptotic critical values. We propose confidence sets with correct coverage in large samples that also have exact coverage in finite samples if distributions are equal up to a transformation. We apply our theory to four commonly-used hypothesis tests of nonparametric functions evaluated at a point. Lastly, simulations show good finite sample properties of our tests.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2021

Prepivoted permutation tests

We present a general approach to constructing permutation tests that are...
research
07/01/2020

Bayesian nonparametric tests for multivariate locations

In this paper, we propose Bayesian non-parametric tests for one-sample a...
research
06/06/2021

Fisher-Pitman permutation tests based on nonparametric Poisson mixtures with application to single cell genomics

This paper investigates the theoretical and empirical performance of Fis...
research
03/05/2023

On the universal distribution of the coverage in split conformal prediction

Two additional universal properties are established in the split conform...
research
05/05/2020

Finite Sample Smeariness of Fréchet Means and Application to Climate

Fréchet means on manifolds are minimizers of expected squared distance, ...
research
01/12/2021

Exact Multivariate Two-Sample Density-Based Empirical Likelihood Ratio Tests Applicable to Retrospective and Group Sequential Studies

Nonparametric tests for equality of multivariate distributions are frequ...
research
12/01/2021

Dynamical hypothesis tests and Decision Theory for Gibbs distributions

We consider the problem of testing for two Gibbs probabilities μ_0 and μ...

Please sign up or login with your details

Forgot password? Click here to reset