Robust estimation with Lasso when outputs are adversarially contaminated

04/13/2020
by   Takeyuki Sasai, et al.
0

We consider robust estimation when outputs are adversarially contaminated. Nguyen and Tran (2012) proposed an extended Lasso for robust parameter estimation and then they showed the convergence rate of the estimation error. Recently, Dalalyan and Thompson (2019) gave some useful inequalities and then they showed a sharper convergence rate than Nguyen and Tran (2012) . They focused on the fact that the minimization problem of the extended Lasso can become that of the penalized Huber loss function with L_1 penalty. The distinguishing point is that the Huber loss function includes an extra tuning parameter, which is different from the conventional method. However, there is a critical mistake in the proof of Dalalyan and Thompson (2019). We improve the proof and then we give a sharper convergence rate than Nguyen and Tran (2012) , when the number of outliers is larger. The significance of our proof is to use some specific properties of the Huber function. Such techniques have not been used in the past proofs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2019

MM for Penalized Estimation

Penalized estimation can conduct variable selection and parameter estima...
research
07/05/2022

Asymptotic Analysis of Parameter Estimation for Ewens–Pitman Partition

We discuss the asymptotic analysis of parameter estimation for Ewens–Pit...
research
10/26/2020

A Homotopic Method to Solve the Lasso Problems with an Improved Upper Bound of Convergence Rate

In optimization, it is known that when the objective functions are stric...
research
05/24/2015

A Fast and Flexible Algorithm for the Graph-Fused Lasso

We propose a new algorithm for solving the graph-fused lasso (GFL), a me...
research
10/06/2020

Unified Robust Estimation via the COCO

Robust estimation is concerned with how to provide reliable parameter es...
research
10/13/2017

On Integrated L^1 Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations

We consider a general monotone regression estimation where we allow for ...
research
06/18/2022

Mind the Gap: Norm-Aware Adaptive Robust Loss for Multivariate Least-Squares Problems

Measurement outliers are unavoidable when solving real-world robot state...

Please sign up or login with your details

Forgot password? Click here to reset