Robust Nonparametric Regression under Huber's ε-contamination Model

05/26/2018
by   Simon S. Du, et al.
0

We consider the non-parametric regression problem under Huber's ϵ-contamination model, in which an ϵ fraction of observations are subject to arbitrary adversarial noise. We first show that a simple local binning median step can effectively remove the adversary noise and this median estimator is minimax optimal up to absolute constants over the Hölder function class with smoothness parameters smaller than or equal to 1. Furthermore, when the underlying function has higher smoothness, we show that using local binning median as pre-preprocessing step to remove the adversarial noise, then we can apply any non-parametric estimator on top of the medians. In particular we show local median binning followed by kernel smoothing and local polynomial regression achieve minimaxity over Hölder and Sobolev classes with arbitrary smoothness parameters. Our main proof technique is a decoupled analysis of adversary noise and stochastic noise, which can be potentially applied to other robust estimation problems. We also provide numerical results to verify the effectiveness of our proposed methods.

READ FULL TEXT

page 9

page 10

research
01/25/2023

Robust non-parametric regression via median-of-means

In this paper, we apply the median-of-means principle to derive robust v...
research
08/29/2022

Quantile absolute deviation

The median absolute deviation (MAD) is a popular robust measure of stati...
research
11/13/2020

Adaptive estimation of a function from its Exponential Radon Transform in presence of noise

In this article we propose a locally adaptive strategy for estimating a ...
research
10/07/2022

Bias-reduced estimation of mean absolute deviation around the median

A bias-reduced estimator is proposed for the mean absolute deviation par...
research
10/12/2020

Distributionally Robust Local Non-parametric Conditional Estimation

Conditional estimation given specific covariate values (i.e., local cond...
research
10/22/2017

Adaptive Bayesian nonparametric regression using kernel mixture of polynomials with application to partial linear model

We propose a kernel mixture of polynomials prior for Bayesian nonparamet...
research
04/10/2019

Network depth: identifying median and contours in complex networks

Centrality descriptors are widely used to rank nodes according to specif...

Please sign up or login with your details

Forgot password? Click here to reset