DeepAI AI Chat
Log In Sign Up

M-estimators of scatter with eigenvalue shrinkage

by   Esa Ollila, et al.

A popular regularized (shrinkage) covariance estimator is the shrinkage sample covariance matrix (SCM) which shares the same set of eigenvectors as the SCM but shrinks its eigenvalues toward its grand mean. In this paper, a more general approach is considered in which the SCM is replaced by an M-estimator of scatter matrix and a fully automatic data adaptive method to compute the optimal shrinkage parameter with minimum mean squared error is proposed. Our approach permits the use of any weight function such as Gaussian, Huber's, or t weight functions, all of which are commonly used in M-estimation framework. Our simulation examples illustrate that shrinkage M-estimators based on the proposed optimal tuning combined with robust weight function do not loose in performance to shrinkage SCM estimator when the data is Gaussian, but provide significantly improved performance when the data is sampled from a heavy-tailed distribution.


page 1

page 2

page 3

page 4


Shrinking the eigenvalues of M-estimators of covariance matrix

A highly popular regularized (shrinkage) covariance matrix estimator is ...

Shrinkage estimation of large covariance matrices using multiple shrinkage targets

Linear shrinkage estimators of a covariance matrix --- defined by a weig...

Multi-Target Shrinkage

Stein showed that the multivariate sample mean is outperformed by "shrin...

Split regression modeling

In this note we study the benefits of splitting variables variables for ...

Shrinkage Estimation of the Frechet Mean in Lie groups

Data in non-Euclidean spaces are commonly encountered in many fields of ...

R-NL: Fast and Robust Covariance Estimation for Elliptical Distributions in High Dimensions

We combine Tyler's robust estimator of the dispersion matrix with nonlin...

Power Transformations of Relative Count Data as a Shrinkage Problem

Here we show an application of our recently proposed information-geometr...