Robust Estimation in High Dimensional Generalized Linear Models

09/29/2017
by   Marina Valdora, et al.
0

Generalized Linear Models are routinely used in data analysis. The classical procedures for estimation are based on Maximum Likelihood and it is well known that the presence of outliers can have a large impact on this estimator. Robust procedures are presented in the literature but they need a robust initial estimate in order to be computed. This is especially important for robust procedures with non convex loss function such as redescending M-estimators. Subsampling techniques are often used to determine a robust initial estimate; however when the number of unknown parameters is large the number of subsamples needed in order to have a high probability of having one subsample free of outliers become infeasible. Furthermore the subsampling procedure provides a non deterministic starting point. Based on ideas in Pena and Yohai (1999), we introduce a deterministic robust initial estimate for M-estimators based on transformations Valdora and Yohai (2014) for which we also develop an iteratively reweighted least squares algorithm. The new methods are studied by Monte Carlo experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2021

A Robust Seemingly Unrelated Regressions For Row-Wise And Cell-Wise Contamination

The Seemingly Unrelated Regressions (SUR) model is a wide used estimatio...
research
01/16/2020

A Support Detection and Root Finding Approach for Learning High-dimensional Generalized Linear Models

Feature selection is important for modeling high-dimensional data, where...
research
04/30/2020

Adaptive Robust Kernels for Non-Linear Least Squares Problems

State estimation is a key ingredient in most robotic systems. Often, sta...
research
05/26/2016

A General Family of Trimmed Estimators for Robust High-dimensional Data Analysis

We consider the problem of robustifying high-dimensional structured esti...
research
09/13/2018

Deterministic Inequalities for Smooth M-estimators

Ever since the proof of asymptotic normality of maximum likelihood estim...
research
05/22/2023

Robust heavy-tailed versions of generalized linear models with applications in actuarial science

Generalized linear models (GLMs) form one of the most popular classes of...
research
07/07/2018

Robust Estimation for Two-Dimensional Autoregressive Processes Based on Bounded Innovation Propagation Representations

Robust methods have been a successful approach to deal with contaminatio...

Please sign up or login with your details

Forgot password? Click here to reset