Designing Differentially Private Estimators in High Dimensions

06/02/2020
by   Aditya Dhar, et al.
0

We study differentially private mean estimation in a high-dimensional setting. Existing differential privacy techniques applied to large dimensions lead to computationally intractable problems or estimators with excessive privacy loss. Recent work in high-dimensional robust statistics has identified computationally tractable mean estimation algorithms with asymptotic dimension-independent error guarantees. We incorporate these results to develop a strict bound on the global sensitivity of the robust mean estimator. This yields a computationally tractable algorithm for differentially private mean estimation in high dimensions with dimension-independent privacy loss. Finally, we show on synthetic data that our algorithm significantly outperforms classic differential privacy methods, overcoming barriers to high-dimensional differential privacy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2012

Convergence Rates for Differentially Private Statistical Estimation

Differential privacy is a cryptographically-motivated definition of priv...
research
02/03/2023

From Robustness to Privacy and Back

We study the relationship between two desiderata of algorithms in statis...
research
11/25/2021

Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanism

We give the first polynomial-time algorithm to estimate the mean of a d-...
research
10/22/2021

Tight and Robust Private Mean Estimation with Few Users

In this work, we study high-dimensional mean estimation under user-level...
research
05/25/2023

Differentially Private Latent Diffusion Models

Diffusion models (DMs) are widely used for generating high-quality image...
research
02/19/2023

Sample-efficient private data release for Lipschitz functions under sparsity assumptions

Differential privacy is the de facto standard for protecting privacy in ...
research
09/19/2019

Differentially Private Regression and Classification with Sparse Gaussian Processes

A continuing challenge for machine learning is providing methods to perf...

Please sign up or login with your details

Forgot password? Click here to reset