Unified Robust Estimation via the COCO

10/06/2020
by   Zhu Wang, et al.
0

Robust estimation is concerned with how to provide reliable parameter estimates in the presence of outliers. Numerous robust loss functions have been proposed in regression and classification, along with various computing algorithms. This article proposes a unified framework for loss function construction and parameter estimation. The CC-family contains composite of concave and convex functions. The properties of the CC-family are investigated, and CC-estimation is innovatively conducted via composite optimization by conjugation operator (COCO). The weighted estimators are simple to implement, demonstrate robust quality in penalized generalized linear models and support vector machines, and can be conveniently extended to even more broad applications with existing software.

READ FULL TEXT
research
01/19/2021

Unified Robust Boosting

Boosting is a popular machine learning algorithm in regression and class...
research
12/23/2019

MM for Penalized Estimation

Penalized estimation can conduct variable selection and parameter estima...
research
02/14/2018

Ultrahigh-dimensional Robust and Efficient Sparse Regression using Non-Concave Penalized Density Power Divergence

We propose a sparse regression method based on the non-concave penalized...
research
12/24/2020

Robust penalized spline estimation with difference penalties

Penalized spline estimation with discrete difference penalties (P-spline...
research
07/23/2010

Support Vector Machines for Additive Models: Consistency and Robustness

Support vector machines (SVMs) are special kernel based methods and belo...
research
04/13/2020

Robust estimation with Lasso when outputs are adversarially contaminated

We consider robust estimation when outputs are adversarially contaminate...
research
02/19/2019

Proper-Composite Loss Functions in Arbitrary Dimensions

The study of a machine learning problem is in many ways is difficult to ...

Please sign up or login with your details

Forgot password? Click here to reset