DeepAI AI Chat
Log In Sign Up

Linear Shrinkage Estimation of Covariance Matrices Using Low-Complexity Cross-Validation

by   Jun Tong, et al.
University of Wollongong

Shrinkage can effectively improve the condition number and accuracy of covariance matrix estimation, especially for low-sample-support applications with the number of training samples smaller than the dimensionality. This paper investigates parameter choice for linear shrinkage estimators. We propose data-driven, leave-one-out cross-validation (LOOCV) methods for automatically choosing the shrinkage coefficients, aiming to minimize the Frobenius norm of the estimation error. A quadratic loss is used as the prediction error for LOOCV. The resulting solutions can be found analytically or by solving optimization problems of small sizes and thus have low complexities. Our proposed methods are compared with various existing techniques. We show that the LOOCV method achieves near-oracle performance for shrinkage designs using sample covariance matrix (SCM) and several typical shrinkage targets. Furthermore, the LOOCV method provides low-complexity solutions for estimators that use general shrinkage targets, multiple targets, and/or ordinary least squares (OLS)-based covariance matrix estimation. We also show applications of our proposed techniques to several different problems in array signal processing.


page 1

page 2

page 3

page 4


Linear shrinkage of sample covariance matrix or matrices under elliptical distributions: a review

This chapter reviews methods for linear shrinkage of the sample covarian...

Find what you are looking for: A data-driven covariance matrix estimation

The global minimum-variance portfolio is a typical choice for investors ...

Cross-validation based Nonlinear Shrinkage

Many machine learning algorithms require precise estimates of covariance...

Shrinkage estimation of large covariance matrices using multiple shrinkage targets

Linear shrinkage estimators of a covariance matrix --- defined by a weig...

Regularized tapered sample covariance matrix

Covariance matrix tapers have a long history in signal processing and re...

Bayesian Covariance Estimation for Multi-group Matrix-variate Data

Multi-group covariance estimation for matrix-variate data with small wit...

A Low-Complexity Antenna-Layout-Aware Spatial Covariance Matrix Estimation Method

This paper proposed a low-complexity antenna layout-aware (ALA) covarian...