Covariance matrix estimation under data-based loss

12/22/2020
by   Anis M. Haddouche, et al.
0

In this paper, we consider the problem of estimating the p× p scale matrix Σ of a multivariate linear regression model Y=X β + ℰ when the distribution of the observed matrix Y belongs to a large class of elliptically symmetric distributions. After deriving the canonical form (Z^T U^T)^T of this model, any estimator Σ̂ of Σ is assessed through the data-based loss tr(S^+Σ (Σ^-1Σ̂ - I_p)^2 ) where S=U^T U is the sample covariance matrix and S^+ is its Moore-Penrose inverse. We provide alternative estimators to the usual estimators a S, where a is a positive constant, which present smaller associated risk. Compared to the usual quadratic loss tr(Σ^-1Σ̂ - I_p)^2, we obtain a larger class of estimators and a wider class of elliptical distributions for which such an improvement occurs. A numerical study illustrates the theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2020

Scale matrix estimation under data-based loss in high and low dimensions

We consider the problem of estimating the scale matrix Σ of the additif ...
research
10/16/2017

Asymptotic distribution of least square estimators for linear models with dependent errors : regular designs

In this paper, we consider the usual linear regression model in the case...
research
12/22/2020

MLE of Jointly Constrained Mean-Covariance of Multivariate Normal Distributions

Estimating the unconstrained mean and covariance matrix is a popular top...
research
09/17/2018

Heteroskedasticity-robust inference in linear regression models

This paper considers inference in heteroskedastic linear regression mode...
research
02/28/2020

Breakdown points of penalized and hybrid M-estimators of covariance

We introduce a class of hybrid M-estimators of multivariate scatter whic...
research
01/23/2019

Optimal Uncertainty Size in Distributionally Robust Inverse Covariance Estimation

In a recent paper, Nguyen, Kuhn, and Esfahani (2018) built a distributio...
research
01/21/2022

Tuned Regularized Estimators for Linear Regression via Covariance Fitting

We consider the problem of finding tuned regularized parameter estimator...

Please sign up or login with your details

Forgot password? Click here to reset