The Price of Differential Privacy under Continual Observation

12/01/2021
by   Palak Jain, et al.
0

We study the accuracy of differentially private mechanisms in the continual release model. A continual release mechanism receives a sensitive dataset as a stream of T inputs and produces, after receiving each input, an accurate output on the obtained inputs. In contrast, a batch algorithm receives the data as one batch and produces a single output. We provide the first strong lower bounds on the error of continual release mechanisms. In particular, for two fundamental problems that are widely studied and used in the batch model, we show that the worst case error of every continual release algorithm is Ω̃(T^1/3) times larger than that of the best batch algorithm. Previous work shows only a polylogarithimic (in T) gap between the worst case error achievable in these two models; further, for many problems, including the summation of binary attributes, the polylogarithmic gap is tight (Dwork et al., 2010; Chan et al., 2010). Our results show that problems closely related to summation – specifically, those that require selecting the largest of a set of sums – are fundamentally harder in the continual release model than in the batch model. Our lower bounds assume only that privacy holds for streams fixed in advance (the "nonadaptive" setting). However, we provide matching upper bounds that hold in a model where privacy is required even for adaptively selected streams. This model may be of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2022

Almost Tight Error Bounds on Differentially Private Continual Counting

The first large-scale deployment of private federated learning uses diff...
research
02/22/2023

Differentially Private Data Structures under Continual Observation for Histograms and Related Queries

Binary counting under continual observation is a well-studied fundamenta...
research
05/05/2023

Differentially-private Continual Releases against Dynamic Databases

Prior research primarily examined differentially-private continual relea...
research
01/13/2023

Differentially Private Continual Releases of Streaming Frequency Moment Estimations

The streaming model of computation is a popular approach for working wit...
research
01/29/2023

Concurrent Shuffle Differential Privacy Under Continual Observation

We introduce the concurrent shuffle model of differential privacy. In th...
research
12/20/2022

Continual Mean Estimation Under User-Level Privacy

We consider the problem of continually releasing an estimate of the popu...
research
11/08/2018

Private Continual Release of Real-Valued Data Streams

We present a differentially private mechanism to display statistics (e.g...

Please sign up or login with your details

Forgot password? Click here to reset