PLAN: Variance-Aware Private Mean Estimation

06/14/2023
βˆ™
by   Martin AumΓΌller, et al.
βˆ™
0
βˆ™

Differentially private mean estimation is an important building block in privacy-preserving algorithms for data analysis and machine learning. Though the trade-off between privacy and utility is well understood in the worst case, many datasets exhibit structure that could potentially be exploited to yield better algorithms. In this paper we present Private Limit Adapted Noise (PLAN), a family of differentially private algorithms for mean estimation in the setting where inputs are independently sampled from a distribution π’Ÿ over 𝐑^d, with coordinate-wise standard deviations Οƒβˆˆπ‘^d. Similar to mean estimation under Mahalanobis distance, PLAN tailors the shape of the noise to the shape of the data, but unlike previous algorithms the privacy budget is spent non-uniformly over the coordinates. Under a concentration assumption on π’Ÿ, we show how to exploit skew in the vector Οƒ, obtaining a (zero-concentrated) differentially private mean estimate with β„“_2 error proportional to Οƒ_1. Previous work has either not taken Οƒ into account, or measured error in Mahalanobis distance x2013 in both cases resulting in β„“_2 error proportional to √(d)Οƒ_2, which can be up to a factor √(d) larger. To verify the effectiveness of PLAN, we empirically evaluate accuracy on both synthetic and real world data.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset