Adaptive Capped Least Squares

06/30/2021
by   Qiang Sun, et al.
0

This paper proposes the capped least squares regression with an adaptive resistance parameter, hence the name, adaptive capped least squares regression. The key observation is, by taking the resistant parameter to be data dependent, the proposed estimator achieves full asymptotic efficiency without losing the resistance property: it achieves the maximum breakdown point asymptotically. Computationally, we formulate the proposed regression problem as a quadratic mixed integer programming problem, which becomes computationally expensive when the sample size gets large. The data-dependent resistant parameter, however, makes the loss function more convex-like for larger-scale problems. This makes a fast randomly initialized gradient descent algorithm possible for global optimization. Numerical examples indicate the superiority of the proposed estimator compared with classical methods. Three data applications to cancer cell lines, stationary background recovery in video surveillance, and blind image inpainting showcase its broad applicability.

READ FULL TEXT

page 19

page 20

page 21

research
02/21/2022

Least sum of squares of trimmed residuals regression

In the famous least sum of trimmed squares (LTS) of residuals estimator ...
research
10/18/2018

Quantile Regression Under Memory Constraint

This paper studies the inference problem in quantile regression (QR) for...
research
04/11/2022

Two-step estimation in linear regressions with adaptive learning

Weak consistency and asymptotic normality of the ordinary least-squares ...
research
04/18/2021

Linear shrinkage for predicting responses in large-scale multivariate linear regression

We propose a new prediction method for multivariate linear regression pr...
research
05/17/2018

k-step correction for mixed integer linear programming: a new approach for instrumental variable quantile regressions and related problems

This paper proposes a new framework for estimating instrumental variable...
research
07/15/2020

Sketching for Two-Stage Least Squares Estimation

When there is so much data that they become a computation burden, it is ...
research
09/16/2017

Multivariate Gaussian Network Structure Learning

We consider a graphical model where a multivariate normal vector is asso...

Please sign up or login with your details

Forgot password? Click here to reset