A Fast Algorithm for Adaptive Private Mean Estimation

01/17/2023
by   John Duchi, et al.
0

We design an (ε, δ)-differentially private algorithm to estimate the mean of a d-variate distribution, with unknown covariance Σ, that is adaptive to Σ. To within polylogarithmic factors, the estimator achieves optimal rates of convergence with respect to the induced Mahalanobis norm ||·||_Σ, takes time Õ(n d^2) to compute, has near linear sample complexity for sub-Gaussian distributions, allows Σ to be degenerate or low rank, and adaptively extends beyond sub-Gaussianity. Prior to this work, other methods required exponential computation time or the superlinear scaling n = Ω(d^3/2) to achieve non-trivial error with respect to the norm ||·||_Σ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2021

Covariance-Aware Private Mean Estimation Without Private Covariance Estimation

We present two sample-efficient differentially private mean estimators f...
research
05/22/2023

Differentially Private Medians and Interior Points for Non-Pathological Data

We construct differentially private estimators with low sample complexit...
research
04/13/2023

A Polynomial Time, Pure Differentially Private Estimator for Binary Product Distributions

We present the first ε-differentially private, computationally efficient...
research
11/08/2021

A Private and Computationally-Efficient Estimator for Unbounded Gaussians

We give the first polynomial-time, polynomial-sample, differentially pri...
research
01/11/2023

Private estimation algorithms for stochastic block models and mixture models

We introduce general tools for designing efficient private estimation al...
research
06/11/2020

CoinPress: Practical Private Mean and Covariance Estimation

We present simple differentially private estimators for the mean and cov...
research
12/09/2021

Estimating the Longest Increasing Subsequence in Nearly Optimal Time

Longest Increasing Subsequence (LIS) is a fundamental statistic of a seq...

Please sign up or login with your details

Forgot password? Click here to reset