On Large-Scale Multiple Testing Over Networks: An Asymptotic Approach

11/29/2022
by   Mehrdad Pournaderi, et al.
0

This work concerns developing communication- and computation-efficient methods for large-scale multiple testing over networks, which is of interest to many practical applications. We take an asymptotic approach and propose two methods, proportion-matching and greedy aggregation, tailored to distributed settings. The proportion-matching method achieves the global BH performance yet only requires a one-shot communication of the (estimated) proportion of true null hypotheses as well as the number of p-values at each node. By focusing on the asymptotic optimal power, we go beyond the BH procedure by providing an explicit characterization of the asymptotic optimal solution. This leads to the greedy aggregation method that effectively approximate the optimal rejection regions at each node, while computation-efficiency comes from the greedy-type approach naturally. Extensive numerical results over a variety of challenging settings are provided to support our theoretical findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2022

Communication-Efficient Distributed Multiple Testing for Large-Scale Inference

The Benjamini-Hochberg (BH) procedure is a celebrated method for multipl...
research
11/22/2022

Robust High-dimensional Tuning Free Multiple Testing

A stylized feature of high-dimensional data is that many variables have ...
research
12/06/2019

On using empirical null distribution in Benjamini-Hochberg procedure

When performing multiple testing, adjusting the distribution of the null...
research
12/06/2019

On using empirical null distributions in Benjamini-Hochberg procedure

When performing multiple testing, adjusting the distribution of the null...
research
11/06/2019

Asymptotic Analysis for Greedy Initialization of Threshold-Based Distributed Optimization of Persistent Monitoring on Graphs

We consider the optimal multi-agent persistent monitoring problem define...
research
05/22/2023

Average-Case Analysis of Greedy Matching for Large-Scale D2D Resource Sharing

Given the proximity of many wireless users and their diversity in consum...

Please sign up or login with your details

Forgot password? Click here to reset