Powerful Partial Conjunction Hypothesis Testing via Conditioning

12/21/2022
by   Biyonka Liang, et al.
0

Research questions across a diverse array of fields are formulated as a Partial Conjunction Hypothesis (PCH) test, which combines information across m base hypotheses to determine whether some subset is non-null. However, standard methods for testing a PCH can be highly conservative. In this paper, we introduce the conditional PCH (cPCH) test, a new framework for testing a single PCH that directly corrects the conservativeness of standard approaches by conditioning on certain order statistics of the base p-values. Under distributional assumptions commonly encountered in PCH testing, the cPCH test produces a p-value that is nearly uniform. Through simulations, we demonstrate that the cPCH test uniformly outperforms standard single PCH tests and maintains Type I error control even under model misspecification, and can in certain situations also be used to outperform state-of-the-art PCH multiple testing procedures. Finally, we illustrate an application of the cPCH test on a replicability analysis of four microarray studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/13/2021

Multiple testing of partial conjunction null hypotheses with conditional p-values based on combination test statistics

The partial conjunction null hypothesis is tested in order to discover a...
research
04/26/2022

E-values as unnormalized weights in multiple testing

Most standard weighted multiple testing methods require the weights to d...
research
02/01/2020

Hypothesis Testing of Blip Effects in Sequential Causal Inference

In this article, we study the hypothesis testing of the blip / net effec...
research
05/11/2018

Agnostic tests can control the type I and type II errors simultaneously

Despite its common practice, statistical hypothesis testing presents cha...
research
05/19/2021

Testing partial conjunction hypotheses under dependency, with applications to meta-analysis

In many statistical problems the hypotheses are naturally divided into g...
research
09/30/2019

Network Differential Connectivity Analysis

Identifying differences in networks has become a canonical problem in ma...
research
07/06/2021

When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing

Scientists often adjust their significance threshold (alpha level) durin...

Please sign up or login with your details

Forgot password? Click here to reset