Asynchronous Online Testing of Multiple Hypotheses

12/12/2018
by   Tijana Zrnic, et al.
0

We consider the problem of asynchronous online testing, aimed at providing control of the false discovery rate (FDR) during a continual stream of data collection and testing, where each test may be a sequential test that can start and stop at arbitrary times. This setting increasingly characterizes real-world applications in science and industry, where teams of researchers across large organizations may conduct tests of hypotheses in a decentralized manner. The overlap in time and space also tends to induce dependencies among test statistics, a challenge for classical methodology, which either assumes (overly optimistically) independence or (overly pessimistically) arbitrary dependence between test statistics. We present a general framework that addresses both of these issues via a unified computational abstraction that we refer to as "conflict sets." We show how this framework yields algorithms with formal FDR guarantees under a more intermediate, local notion of dependence. We illustrate these algorithms in simulation experiments, comparing to existing algorithms for online FDR control.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2021

SAFFRON and LORD Ensure Online Control of the False Discovery Rate Under Positive Dependence

Online testing procedures assume that hypotheses are observed in sequenc...
research
02/08/2022

Online error control for platform trials

Platform trials evaluate multiple experimental treatments under a single...
research
10/04/2021

Online Control of the False Discovery Rate under "Decision Deadlines"

Online testing procedures aim to control the extent of false discoveries...
research
10/09/2022

QuTE: decentralized multiple testing on sensor networks with false discovery rate control

This paper designs methods for decentralized multiple hypothesis testing...
research
03/18/2017

A unified treatment of multiple testing with prior knowledge using the p-filter

A significant literature studies ways of employing prior knowledge to im...
research
10/11/2019

The Power of Batching in Multiple Hypothesis Testing

One important partition of algorithms for controlling the false discover...
research
04/19/2023

Asymptotically Optimal Sequential Multiple Testing with Asynchronous Decisions

The problem of simultaneously testing the marginal distributions of sequ...

Please sign up or login with your details

Forgot password? Click here to reset