Unified Robust Estimation via the COCO

10/06/2020
by   Zhu Wang, et al.
0

Robust estimation is concerned with how to provide reliable parameter estimates in the presence of outliers. Numerous robust loss functions have been proposed in regression and classification, along with various computing algorithms. This article proposes a unified framework for loss function construction and parameter estimation. The CC-family contains composite of concave and convex functions. The properties of the CC-family are investigated, and CC-estimation is innovatively conducted via composite optimization by conjugation operator (COCO). The weighted estimators are simple to implement, demonstrate robust quality in penalized generalized linear models and support vector machines, and can be conveniently extended to even more broad applications with existing software.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 36

01/19/2021

Unified Robust Boosting

Boosting is a popular machine learning algorithm in regression and class...
12/23/2019

MM for Penalized Estimation

Penalized estimation can conduct variable selection and parameter estima...
02/14/2018

Ultrahigh-dimensional Robust and Efficient Sparse Regression using Non-Concave Penalized Density Power Divergence

We propose a sparse regression method based on the non-concave penalized...
07/23/2010

Support Vector Machines for Additive Models: Consistency and Robustness

Support vector machines (SVMs) are special kernel based methods and belo...
04/13/2020

Robust estimation with Lasso when outputs are adversarially contaminated

We consider robust estimation when outputs are adversarially contaminate...
01/23/2019

Unified efficient estimation framework for unnormalized models

Parameter estimation of unnormalized models is a challenging problem bec...
01/06/2022

Robust Linear Predictions: Analyses of Uniform Concentration, Fast Rates and Model Misspecification

The problem of linear predictions has been extensively studied for the p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.