Multiple testing of partial conjunction null hypotheses with conditional p-values based on combination test statistics

10/13/2021
by   Thorsten Dickhaus, et al.
0

The partial conjunction null hypothesis is tested in order to discover a signal that is present in multiple studies. We propose methods for multiple testing of partial conjunction null hypotheses which make use of conditional p-values based on combination test statistics. Specific examples comprise the Fisher combination function and the Stouffer combination function. The conditional validity of the corresponding p-values is proved for certain classes of one-parametric statistical models, including one-parameter natural exponential families. The standard approach of carrying out a multiple test procedure on the (unconditional) partial conjunction p-values can be extremely conservative. We suggest alleviating this conservativeness, by eliminating many of the conservative partial conjunction p-values prior to the application of a multiple test procedure. This leads to the following two step procedure: first, select the set with partial conjunction p-values below a selection threshold; second, within the selected set only, apply a family-wise error rate or false discovery rate controlling procedure on the conditional partial conjunction p-values. By means of computer simulations and real data analyses, we compare the proposed methodology with other recent approaches.

READ FULL TEXT
research
12/21/2022

Powerful Partial Conjunction Hypothesis Testing via Conditioning

Research questions across a diverse array of fields are formulated as a ...
research
05/19/2021

Testing partial conjunction hypotheses under dependency, with applications to meta-analysis

In many statistical problems the hypotheses are naturally divided into g...
research
07/06/2021

When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing

Scientists often adjust their significance threshold (alpha level) durin...
research
12/30/2017

Gaining power in multiple testing of interval hypotheses via conditionalization

In this paper we introduce a novel procedure for improving multiple test...
research
05/15/2019

False Discovery Rates to Detect Signals from Incomplete Spatially Aggregated Data

There are a number of ways to test for the absence/presence of a spatial...
research
12/15/2019

Randomized p-values for multiple testing and their application in replicability analysis

We are concerned with testing replicability hypotheses for many endpoint...
research
09/14/2023

A minimum Wasserstein distance approach to Fisher's combination of independent discrete p-values

This paper introduces a comprehensive framework to adjust a discrete tes...

Please sign up or login with your details

Forgot password? Click here to reset