The AUGUST Two-Sample Test: Powerful, Interpretable, and Fast

09/28/2021
by   Benjamin Brown, et al.
0

Two-sample testing is a fundamental problem in statistics, and many famous two-sample tests are designed to be fully non-parametric. These existing methods perform well with location and scale shifts but are less robust when faced with more exotic classes of alternatives, and rejections from these tests can be difficult to interpret. Here, we propose a new univariate non-parametric two-sample test, AUGUST, designed to improve on these aspects. AUGUST tests for inequality in distribution up to a predetermined resolution using symmetry statistics from binary expansion. The AUGUST statistic is exactly distribution-free and has a well-understood asymptotic distribution, permitting fast p-value computation. In empirical studies, we show that AUGUST has power comparable to that of the best existing methods in every context, as well as greater power in some circumstances. We illustrate the clear interpretability of AUGUST on NBA shooting data.

READ FULL TEXT

page 13

page 29

research
09/28/2022

Using the Sinkhorn divergence in permutation tests for the multivariate two-sample problem

In order to adapt the Wasserstein distance to the large sample multivari...
research
03/01/2021

BEAUTY Powered BEAST

We study inference about the uniform distribution with the proposed bina...
research
08/15/2020

Generalized Spacing-Statistics and a New Family of Non-Parametric Tests

Random divisions of an interval arise in various context, including stat...
research
09/28/2022

Exact and efficient multivariate two-sample tests through generalized linear rank statistics

So-called linear rank statistics provide a means for distribution-free (...
research
04/06/2023

U-Statistics Based Jackknife Empirical Likelihood Tests for the Generalized Lorenz Curves

A Lorenz curve is a graphical representation of the distribution of inco...
research
11/17/2016

Fast Non-Parametric Tests of Relative Dependency and Similarity

We introduce two novel non-parametric statistical hypothesis tests. The ...
research
12/08/2019

Testing Independence with the Binary Expansion Randomized Ensemble Test

Recently, the binary expansion testing framework was introduced to test ...

Please sign up or login with your details

Forgot password? Click here to reset