Locally Private Hypothesis Selection

02/21/2020
by   Sivakanth Gopi, et al.
0

We initiate the study of hypothesis selection under local differential privacy. Given samples from an unknown probability distribution p and a set of k probability distributions Q, we aim to output, under the constraints of ε-local differential privacy, a distribution from Q whose total variation distance to p is comparable to the best such distribution. This is a generalization of the classic problem of k-wise simple hypothesis testing, which corresponds to when p ∈Q, and we wish to identify p. Absent privacy constraints, this problem requires O(log k) samples from p, and it was recently shown that the same complexity is achievable under (central) differential privacy. However, the naive approach to this problem under local differential privacy would require Õ(k^2) samples. We first show that the constraint of local differential privacy incurs an exponential increase in cost: any algorithm for this problem requires at least Ω(k) samples. Second, for the special case of k-wise simple hypothesis testing, we provide a non-interactive algorithm which nearly matches this bound, requiring Õ(k) samples. Finally, we provide sequentially interactive algorithms for the general case, requiring Õ(k) samples and only O(loglog k) rounds of interactivity. Our algorithms are achieved through a reduction to maximum selection with adversarial comparators, a problem of independent interest for which we initiate study in the parallel setting. For this problem, we provide a family of algorithms for each number of allowed rounds of interaction t, as well as lower bounds showing that they are near-optimal for every t. Notably, our algorithms result in exponential improvements on the round complexity of previous methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/07/2019

The Role of Interactivity in Local Differential Privacy

We study the power of interactivity in local differential privacy. First...
05/30/2019

Private Hypothesis Selection

We provide a differentially private algorithm for hypothesis selection. ...
07/21/2020

Interactive Inference under Information Constraints

We consider distributed inference using sequentially interactive protoco...
07/06/2021

Goodness-of-fit testing for Hölder continuous densities under local differential privacy

We address the problem of goodness-of-fit testing for Hölder continuous ...
05/26/2020

Locally private non-asymptotic testing of discrete distributions is faster using interactive mechanisms

We find separation rates for testing multinomial or more general discret...
01/24/2021

A Linear Reduction Method for Local Differential Privacy and Log-lift

This paper considers the problem of publishing data X while protecting c...
09/24/2018

Learning without Interaction Requires Separation

One of the key resources in large-scale learning systems is the number o...