Large-dimensional behavior of regularized Maronna's M-estimators of covariance matrices

04/26/2018
by   Nicolas Auguin, et al.
0

Robust estimators of large covariance matrices are considered, comprising regularized (linear shrinkage) modifications of Maronna's classical M-estimators. These estimators provide robustness to outliers, while simultaneously being well-defined when the number of samples does not exceed the number of variables. By applying tools from random matrix theory, we characterize the asymptotic performance of such estimators when the numbers of samples and variables grow large together. In particular, our results show that, when outliers are absent, many estimators of the regularized-Maronna type share the same asymptotic performance, and for these estimators we present a data-driven method for choosing the asymptotically optimal regularization parameter with respect to a quadratic loss. Robustness in the presence of outliers is then studied: in the non-regularized case, a large-dimensional robustness metric is proposed, and explicitly computed for two particular types of estimators, exhibiting interesting differences depending on the underlying contamination model. The impact of outliers in regularized estimators is then studied, with interesting differences with respect to the non-regularized case, leading to new practical insights on the choice of particular estimators.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2015

Large Dimensional Analysis of Robust M-Estimators of Covariance with Outliers

A large dimensional characterization of robust M-estimators of covarianc...
research
12/19/2017

Some Large Sample Results for the Method of Regularized Estimators

We present a general framework for studying regularized estimators; i.e....
research
11/09/2020

Coupled regularized sample covariance matrix estimator for multiple classes

The estimation of covariance matrices of multiple classes with limited t...
research
06/05/2019

Robustness and Tractability for Non-convex M-estimators

We investigate two important properties of M-estimator, namely, robustne...
research
09/15/2022

The Influence Function of Graphical Lasso Estimators

The precision matrix that encodes conditional linear dependency relation...
research
10/24/2019

ERM and RERM are optimal estimators for regression problems when malicious outliers corrupt the labels

We study Empirical Risk Minimizers (ERM) and Regularized Empirical Risk ...
research
01/21/2022

Tuned Regularized Estimators for Linear Regression via Covariance Fitting

We consider the problem of finding tuned regularized parameter estimator...

Please sign up or login with your details

Forgot password? Click here to reset