Outlier-Robust High-Dimensional Sparse Estimation via Iterative Filtering

11/19/2019
by   Ilias Diakonikolas, et al.
26

We study high-dimensional sparse estimation tasks in a robust setting where a constant fraction of the dataset is adversarially corrupted. Specifically, we focus on the fundamental problems of robust sparse mean estimation and robust sparse PCA. We give the first practically viable robust estimators for these problems. In more detail, our algorithms are sample and computationally efficient and achieve near-optimal robustness guarantees. In contrast to prior provable algorithms which relied on the ellipsoid method, our algorithms use spectral techniques to iteratively remove outliers from the dataset. Our experimental evaluation on synthetic data shows that our algorithms are scalable and significantly outperform a range of previous approaches, nearly matching the best error rate without corruptions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2022

Streaming Algorithms for High-Dimensional Robust Statistics

We study high-dimensional robust statistics tasks in the streaming model...
research
05/29/2018

High Dimensional Robust Sparse Regression

We provide a novel -- and to the best of our knowledge, the first -- alg...
research
07/30/2020

Outlier Robust Mean Estimation with Subgaussian Rates via Stability

We study the problem of outlier robust high-dimensional mean estimation ...
research
09/23/2021

Outlier-Robust Sparse Estimation via Non-Convex Optimization

We explore the connection between outlier-robust high-dimensional statis...
research
08/10/2022

Robust methods for high-dimensional linear learning

We propose statistically robust and computationally efficient linear lea...
research
02/03/2021

Outlier-Robust Learning of Ising Models Under Dobrushin's Condition

We study the problem of learning Ising models satisfying Dobrushin's con...
research
04/21/2016

Robust Estimators in High Dimensions without the Computational Intractability

We study high-dimensional distribution learning in an agnostic setting w...

Please sign up or login with your details

Forgot password? Click here to reset