Outlier Robust and Sparse Estimation of Linear Regression Coefficients

08/24/2022
by   Takeyuki Sasai, et al.
0

We consider outlier robust and sparse estimation of linear regression coefficients when covariates and noise are sampled, respectively, from an 𝔏-subGaussian distribution and a heavy-tailed distribution, and additionally, the covariates and noise are contaminated by adversarial outliers. We deal with two cases: known or unknown covariance of the covariates. Particularly, in the former case, our estimator attains nearly information theoretical optimal error bound, and our error bound is sharper than that of earlier studies dealing with similar situations. Our estimator analysis relies heavily on Generic Chaining to derive sharp error bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2022

Robust and Sparse Estimation of Linear Regression Coefficients with Heavy-tailed Noises and Covariates

Robust and sparse estimation of linear regression coefficients is invest...
research
04/24/2023

Estimation of sparse linear regression coefficients under L-subexponential covariates

We address a task of estimating sparse coefficients in linear regression...
research
03/19/2019

Adaptive Hard Thresholding for Near-optimal Consistent Robust Regression

We study the problem of robust linear regression with response variable ...
research
07/07/2013

Loss minimization and parameter estimation with heavy tails

This work studies applications and generalizations of a simple estimatio...
research
05/28/2022

Functional Linear Regression of CDFs

The estimation of cumulative distribution functions (CDF) is an importan...
research
05/11/2021

Trimmed Minimum Error Entropy for Robust Online Regression

In this paper, online linear regression in environments corrupted by non...
research
07/18/2017

Global optimization for low-dimensional switching linear regression and bounded-error estimation

The paper provides global optimization algorithms for two particularly d...

Please sign up or login with your details

Forgot password? Click here to reset