Scale calibration for high-dimensional robust regression

11/06/2018
by   Po-Ling Loh, et al.
0

We present a new method for high-dimensional linear regression when a scale parameter of the additive errors is unknown. The proposed estimator is based on a penalized Huber M-estimator, for which theoretical results on estimation error have recently been proposed in high-dimensional statistics literature. However, the variance of the error term in the linear model is intricately connected to the optimal parameter used to define the shape of the Huber loss. Our main idea is to use an adaptive technique, based on Lepski's method, to overcome the difficulties in solving a joint nonconvex optimization problem with respect to the location and scale parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2019

Minimax rates of ℓ_p-losses for high-dimensional linear regression models with additive measurement errors over ℓ_q-balls

We study minimax rates for high-dimensional linear regression with addit...
research
03/12/2018

M-estimation in high-dimensional linear model

We mainly study the M-estimation method for the high-dimensional linear ...
research
04/12/2022

High-dimensional nonconvex lasso-type M-estimators

This paper proposes a theory for ℓ_1-norm penalized high-dimensional M-e...
research
08/18/2019

Semiparametric Expectile Regression for High-dimensional Heavy-tailed and Heterogeneous Data

Recently, high-dimensional heterogeneous data have attracted a lot of at...
research
05/13/2015

Optimal linear estimation under unknown nonlinear transform

Linear regression studies the problem of estimating a model parameter β^...
research
12/26/2019

A Simple Correction Procedure for High-Dimensional General Linear Models with Measurement Error

We consider high-dimensional generalized linear models when the covariat...
research
11/10/2020

Using parameter elimination to solve discrete linear Chebyshev approximation problems

We consider discrete linear Chebyshev approximation problems in which th...

Please sign up or login with your details

Forgot password? Click here to reset