List-Decodable Mean Estimation via Iterative Multi-Fitering

06/18/2020
by   Ilias Diakonikolas, et al.
0

We study the problem of list-decodable mean estimation for bounded covariance distributions. Specifically, we are given a set T of points in R^d with the promise that an unknown α-fraction of points in T, where 0< α < 1/2, are drawn from an unknown mean and bounded covariance distribution D, and no assumptions are made on the remaining points. The goal is to output a small list of hypothesis vectors such that at least one of them is close to the mean of D. We give the first practically viable estimator for this problem. In more detail, our algorithm is sample and computationally efficient, and achieves information-theoretically near-optimal error. While the only prior algorithm for this setting inherently relied on the ellipsoid method, our algorithm is iterative and only uses spectral techniques. Our main technical innovation is the design of a soft outlier removal procedure for high-dimensional heavy-tailed datasets with a majority of outliers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2020

List-Decodable Mean Estimation via Iterative Multi-Filtering

We study the problem of list-decodable mean estimation for bounded covar...
research
06/10/2022

List-Decodable Sparse Mean Estimation via Difference-of-Pairs Filtering

We study the problem of list-decodable sparse mean estimation. Specifica...
research
05/01/2023

A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius Norm

We study the problem of list-decodable Gaussian covariance estimation. G...
research
11/07/2016

Learning from Untrusted Data

The vast majority of theoretical results in machine learning and statist...
research
05/20/2020

List Decodable Mean Estimation in Nearly Linear Time

Learning from data in the presence of outliers is a fundamental problem ...
research
11/19/2020

List-Decodable Mean Estimation in Nearly-PCA Time

Traditionally, robust statistics has focused on designing estimators tol...
research
05/28/2022

List-Decodable Sparse Mean Estimation

Robust mean estimation is one of the most important problems in statisti...

Please sign up or login with your details

Forgot password? Click here to reset