A minimum Wasserstein distance approach to Fisher's combination of independent discrete p-values

09/14/2023
by   Gonzalo Contador, et al.
0

This paper introduces a comprehensive framework to adjust a discrete test statistic for improving its hypothesis testing procedure. The adjustment minimizes the Wasserstein distance to a null-approximating continuous distribution, tackling some fundamental challenges inherent in combining statistical significances derived from discrete distributions. The related theory justifies Lancaster's mid-p and mean-value chi-squared statistics for Fisher's combination as special cases. However, in order to counter the conservative nature of Lancaster's testing procedures, we propose an updated null-approximating distribution. It is achieved by further minimizing the Wasserstein distance to the adjusted statistics within a proper distribution family. Specifically, in the context of Fisher's combination, we propose an optimal gamma distribution as a substitute for the traditionally used chi-squared distribution. This new approach yields an asymptotically consistent test that significantly improves type I error control and enhances statistical power.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/29/2017

Finite-sample bounds for the multivariate Behrens-Fisher distribution with proportional covariances

The Behrens-Fisher problem is a well-known hypothesis testing problem in...
research
04/27/2021

Combining independent p-values in replicability analysis: A comparative study

Given a family of null hypotheses H_1,…,H_s, we are interested in the hy...
research
10/13/2021

Multiple testing of partial conjunction null hypotheses with conditional p-values based on combination test statistics

The partial conjunction null hypothesis is tested in order to discover a...
research
03/22/2022

Bounds on Wasserstein distances between continuous distributions using independent samples

The plug-in estimator of the Wasserstein distance is known to be conserv...
research
04/07/2008

Testing for Homogeneity with Kernel Fisher Discriminant Analysis

We propose to investigate test statistics for testing homogeneity in rep...
research
06/02/2023

The Fisher Geometry and Geodesics of the Multivariate Normals, without Differential Geometry

Choosing the Fisher information as the metric tensor for a Riemannian ma...
research
03/03/2020

Accurate p-Value Calculation for Generalized Fisher's Combination Tests Under Dependence

Combining dependent tests of significance has broad applications but the...

Please sign up or login with your details

Forgot password? Click here to reset