The Lévy combination test

05/04/2021
by   Daniel J. Wilson, et al.
0

A novel class of methods for combining p-values to perform aggregate hypothesis tests has emerged that exploit the properties of heavy-tailed Stable distributions. These methods offer important practical advantages including robustness to dependence and better-than-Bonferroni scaleability, and they reveal theoretical connections between Bayesian and classical hypothesis tests. The harmonic mean p-value (HMP) procedure is based on the convergence of summed inverse p-values to the Landau distribution, while the Cauchy combination test (CCT) is based on the self-similarity of summed Cauchy-transformed p-values. The CCT has the advantage that it is analytic and exact. The HMP has the advantage that it emulates a model-averaged Bayes factor, is insensitive to p-values near 1, and offers multilevel testing via a closed testing procedure. Here I investigate whether other Stable combination tests can combine these benefits, and identify a new method, the Lévy combination test (LCT). The LCT exploits the self-similarity of sums of Lévy random variables transformed from p-values. Under arbitrary dependence, the LCT possesses better robustness than the CCT and HMP, with two-fold worst-case inflation at small significance thresholds. It controls the strong-sense familywise error rate through a multilevel test uniformly more powerful than Bonferroni. Simulations show that the LCT behaves like Simes' test in some respects, with power intermediate between the HMP and Bonferroni. The LCT represents an interesting and attractive addition to combined testing methods based on heavy-tailed distributions.

READ FULL TEXT
research
03/24/2021

Heavy-tailed distribution for combining dependent p-values with asymptotic robustness

The issue of combining individual p-values to aggregate multiple small e...
research
12/06/2021

Hypothesis Test of a Truncated Sample Mean for the Extremely Heavy-Tailed Distributions

This article deals with the hypothesis test for the extremely heavy-tail...
research
01/29/2018

Test Martingales for bounded random variables

Test martingales have been proposed as a more intuitive approach to hypo...
research
06/18/2019

Safe Testing

We present a new theory of hypothesis testing. The main concept is the S...
research
08/17/2021

Stable combination tests

This paper proposes a stable combination test, which is a natural extens...
research
07/13/2021

Cauchy Combination Test for Sparse Signals

Aggregating multiple effects is often encountered in large-scale data an...

Please sign up or login with your details

Forgot password? Click here to reset