A General Method for Robust Learning from Batches

02/25/2020
by   Alon Orlitsky, et al.
0

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of robust learning from batches, and determine the limits of both classification and distribution estimation over arbitrary, including continuous, domains. Building on these results, we derive the first robust agnostic computationally-efficient learning algorithms for piecewise-interval classification, and for piecewise-polynomial, monotone, log-concave, and gaussian-mixture distribution estimation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2013

Efficient Density Estimation via Piecewise Polynomial Approximation

We give a highly efficient "semi-agnostic" algorithm for learning univar...
research
08/18/2020

Robust Mean Estimation on Highly Incomplete Data with Arbitrary Outliers

We study the problem of robustly estimating the mean of a d-dimensional ...
research
02/22/2020

SURF: A Simple, Universal, Robust, Fast Distribution Learning Algorithm

Sample- and computationally-efficient distribution estimation is a funda...
research
06/15/2010

Solving Inverse Problems with Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity

A general framework for solving image inverse problems is introduced in ...
research
03/21/2023

Sampling from a Gaussian distribution conditioned on the level set of a piecewise affine, continuous function

We consider how to use Hamiltonian Monte Carlo to sample from a distribu...
research
08/30/2021

Generalized nearly isotonic regression

The problem of estimating a piecewise monotone sequence of normal means ...
research
09/05/2023

Distributionally Robust Machine Learning with Multi-source Data

Classical machine learning methods may lead to poor prediction performan...

Please sign up or login with your details

Forgot password? Click here to reset