Communication and Memory Efficient Testing of Discrete Distributions

06/11/2019
by   Ilias Diakonikolas, et al.
0

We study distribution testing with communication and memory constraints in the following computational models: (1) The one-pass streaming model where the goal is to minimize the sample complexity of the protocol subject to a memory constraint, and (2) A distributed model where the data samples reside at multiple machines and the goal is to minimize the communication cost of the protocol. In both these models, we provide efficient algorithms for uniformity/identity testing (goodness of fit) and closeness testing (two sample testing). Moreover, we show nearly-tight lower bounds on (1) the sample complexity of any one-pass streaming tester for uniformity, subject to the memory constraint, and (2) the communication cost of any uniformity testing protocol, in a restricted `one-pass' model of communication.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/06/2023

Testing properties of distributions in the streaming model

We study distribution testing in the standard access model and the condi...
research
03/04/2018

Detecting Correlations with Little Memory and Communication

We study the problem of identifying correlations in multivariate data, u...
research
08/18/2022

Optimal One-pass Nonparametric Estimation Under Memory Constraint

For nonparametric regression in the streaming setting, where data consta...
research
07/20/2019

Domain Compression and its Application to Randomness-Optimal Distributed Goodness-of-Fit

We study goodness-of-fit of discrete distributions in the distributed se...
research
04/27/2020

Testing Data Binnings

Motivated by the question of data quantization and "binning," we revisit...
research
06/28/2013

Memory Limited, Streaming PCA

We consider streaming, one-pass principal component analysis (PCA), in t...
research
07/17/2022

Online Lewis Weight Sampling

The seminal work of Cohen and Peng introduced Lewis weight sampling to t...

Please sign up or login with your details

Forgot password? Click here to reset