An Adaptive-Discard-Graph for online error control

01/27/2023
by   Lasse Fischer, et al.
0

In recent years, graphical multiple testing procedures have gained popularity due to their generality and ease of interpretation. In contemporary research, online error control is often required, where an error criterion, such as familywise error rate (FWER) or false discovery rate (FDR), shall remain under control while testing an a priori unbounded sequence of hypotheses. Although the classical graphical procedure can be extended to the online setting, previous work has shown that it leads to low power, and other approaches, such as Adaptive-Discard (ADDIS) procedures, are preferred instead. In this paper, we introduce an ADDIS-Graph with FWER control and its extension for the FDR setting. These graphical ADDIS procedures combine the good interpretability of graphical procedures with the high online power of ADDIS procedures. Moreover, they can be adapted to a local dependence structure and an asynchronous testing setup, leading to power improvements over the current state-of-art methods. Consequently, the proposed methods are useful for a wide range of applications, including innovative complex trial designs, such as platform trials, and large-scale test designs, such as in the evaluation of A/B tests for marketing research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2020

Graphical approaches for the control of generalised error rates

When simultaneously testing multiple hypotheses, the usual approach in t...
research
08/26/2023

An exhaustive ADDIS principle for online FWER control

In this paper we consider online multiple testing with familywise error ...
research
12/01/2018

A New Approach for Large Scale Multiple Testing with Application to FDR Control for Graphically Structured Hypotheses

In many large scale multiple testing applications, the hypotheses often ...
research
02/08/2022

Online error control for platform trials

Platform trials evaluate multiple experimental treatments under a single...
research
12/20/2021

Online control of the False Discovery Rate in group-sequential platform trials

When testing multiple hypotheses, a suitable error rate should be contro...
research
11/21/2022

The Online Closure Principle

The closure principle is fundamental in multiple testing and has been us...
research
05/27/2019

ADDIS: adaptive algorithms for online FDR control with conservative nulls

Major internet companies routinely perform tens of thousands of A/B test...

Please sign up or login with your details

Forgot password? Click here to reset