Mean Estimation with Sub-Gaussian Rates in Polynomial Time

09/19/2018
by   Samuel B. Hopkins, et al.
0

We study polynomial time algorithms for estimating the mean of a heavy-tailed multivariate random vector. We assume only that the random vector X has finite mean and covariance. In this setting, the radius of confidence intervals achieved by the empirical mean are large compared to the case that X is Gaussian or sub-Gaussian. We offer the first polynomial time algorithm to estimate the mean with sub-Gaussian-size confidence intervals under such mild assumptions. Our algorithm is based on a new semidefinite programming relaxation of a high-dimensional median. Previous estimators which assumed only existence of finitely-many moments of X either sacrifice sub-Gaussian performance or are only known to be computable via brute-force search procedures requiring time exponential in the dimension.

READ FULL TEXT
research
09/19/2018

Sub-Gaussian Mean Estimation in Polynomial Time

We study polynomial time algorithms for estimating the mean of a random ...
research
12/23/2019

Algorithms for Heavy-Tailed Statistics: Regression, Covariance Estimation, and Beyond

We study efficient algorithms for linear regression and covariance estim...
research
02/06/2019

Fast Mean Estimation with Sub-Gaussian Rates

We propose an estimator for the mean of a random vector in R^d that can ...
research
12/20/2022

A polynomial time additive estimate of the permanent using Gaussian fields

We present a polynomial-time randomized algorithm for estimating the per...
research
08/13/2019

A Fast Spectral Algorithm for Mean Estimation with Sub-Gaussian Rates

We study the algorithmic problem of estimating the mean of heavy-tailed ...
research
02/02/2022

Catoni-style confidence sequences for heavy-tailed mean estimation

A confidence sequence (CS) is a sequence of confidence intervals that is...
research
12/10/2018

Testing for high-dimensional network paramaters in auto-regressive models

High-dimensional auto-regressive models provide a natural way to model i...

Please sign up or login with your details

Forgot password? Click here to reset