'Too Many, Too Improbable' test statistics: A general method for testing joint hypotheses and controlling the k-FWER

08/10/2021
by   Phillip B Mogensen, et al.
0

Hypothesis testing is a key part of empirical science and multiple testing as well as the combination of evidence from several tests are continued areas of research. In this article we consider the problem of combining the results of multiple hypothesis tests to i) test global hypotheses and ii) make marginal inference while controlling the k-FWER. We propose a new family of combination tests for joint hypotheses, which we show through simulation to have higher power than other combination tests against many alternatives. Furthermore, we prove that a large family of combination tests – which includes the one we propose but also other combination tests – admits a quadratic shortcut when used in a , which controls the FWER strongly. We develop an algorithm that is linear in the number of hypotheses for obtaining confidence sets for the number of false hypotheses among a collection of hypotheses and an algorithm that is cubic in the number of hypotheses for controlling the k-FWER for any k greater than one.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/13/2019

Interpretable hypothesis tests

Although hypothesis tests play a prominent role in Science, their interp...
11/21/2021

Confidences in Hypotheses

This article introduces a broadly-applicable new method of statistical a...
02/25/2022

Familial Inference

Statistical hypotheses are translations of scientific hypotheses into st...
02/11/2023

The Kruskal Wallis test can not be recommended

Although the Kruskal-Wallis (KW) test is widely used, it should not be r...
01/26/2018

Multiplication-Combination Tests for Incomplete Paired Data

We consider statistical procedures for hypothesis testing of real valued...
03/17/2022

Properties of a confirmatory two-stage adaptive procedure for assessing average bioequivalence

We investigate a confirmatory two stage adaptive procedure for assessing...

Code Repositories

TMTI

This repository contains the R package 'TMTI'


view repo

TMTI

:exclamation: This is a read-only mirror of the CRAN R package repository. TMTI — 'Too Many, Too Improbable' (TMTI) Test Procedures


view repo

Please sign up or login with your details

Forgot password? Click here to reset