Covariance Estimation: Optimal Dimension-free Guarantees for Adversarial Corruption and Heavy Tails

05/17/2022
by   Pedro Abdalla, et al.
0

We provide an estimator of the covariance matrix that achieves the optimal rate of convergence (up to constant factors) in the operator norm under two standard notions of data contamination: We allow the adversary to corrupt an η-fraction of the sample arbitrarily, while the distribution of the remaining data points only satisfies that the L_p-marginal moment with some p ≥ 4 is equivalent to the corresponding L_2-marginal moment. Despite requiring the existence of only a few moments, our estimator achieves the same tail estimates as if the underlying distribution were Gaussian. As a part of our analysis, we prove a dimension-free Bai-Yin type theorem in the regime p > 4.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2022

Improved covariance estimation: optimal robustness and sub-Gaussian guarantees under heavy tails

We present an estimator of the covariance matrix Σ of random d-dimension...
research
01/21/2023

Statistically Optimal Robust Mean and Covariance Estimation for Anisotropic Gaussians

Assume that X_1, …, X_N is an ε-contaminated sample of N independent Gau...
research
03/06/2022

Robust Estimation of Covariance Matrices: Adversarial Contamination and Beyond

We consider the problem of estimating the covariance structure of a rand...
research
05/22/2023

Covariance Estimation under Missing Observations and L_4-L_2 Moment Equivalence

We consider the problem of estimating the covariance matrix of a random ...
research
06/19/2022

Frank-Wolfe-based Algorithms for Approximating Tyler's M-estimator

Tyler's M-estimator is a well known procedure for robust and heavy-taile...
research
08/30/2023

A Parameter-Free Two-Bit Covariance Estimator with Improved Operator Norm Error Rate

A covariance matrix estimator using two bits per entry was recently deve...
research
07/24/2023

Tuning-free one-bit covariance estimation using data-driven dithering

We consider covariance estimation of any subgaussian distribution from f...

Please sign up or login with your details

Forgot password? Click here to reset