Optimal high-dimensional and nonparametric distributed testing under communication constraints

02/02/2022
by   Botond Szabo, et al.
0

We derive minimax testing errors in a distributed framework where the data is split over multiple machines and their communication to a central machine is limited to b bits. We investigate both the d- and infinite-dimensional signal detection problem under Gaussian white noise. We also derive distributed testing algorithms reaching the theoretical lower bounds. Our results show that distributed testing is subject to fundamentally different phenomena that are not observed in distributed estimation. Among our findings, we show that testing protocols that have access to shared randomness can perform strictly better in some regimes than those that do not. Furthermore, we show that consistent nonparametric distributed testing is always possible, even with as little as 1-bit of communication and the corresponding test outperforms the best local test using only the information available at a single local machine.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2018

Adaptive distributed methods under communication constraints

We study distributed estimation methods under communication constraints ...
research
12/09/2020

Optimal distributed testing in high-dimensional Gaussian models

In this paper study the problem of signal detection in Gaussian noise in...
research
05/21/2020

Communication Complexity of Distributed High Dimensional Correlation Testing

Two parties observe independent copies of a d-dimensional vector and a s...
research
04/21/2022

Distributed Nonparametric Estimation under Communication Constraints

In the era of big data, it is necessary to split extremely large data se...
research
03/04/2018

Distributed Nonparametric Regression under Communication Constraints

This paper studies the problem of nonparametric estimation of a smooth f...
research
11/08/2017

An asymptotic analysis of distributed nonparametric methods

We investigate and compare the fundamental performance of several distri...
research
05/20/2019

Inference under Information Constraints II: Communication Constraints and Shared Randomness

A central server needs to perform statistical inference based on samples...

Please sign up or login with your details

Forgot password? Click here to reset