Cross-validation based Nonlinear Shrinkage

11/02/2016
by   Daniel Bartz, et al.
0

Many machine learning algorithms require precise estimates of covariance matrices. The sample covariance matrix performs poorly in high-dimensional settings, which has stimulated the development of alternative methods, the majority based on factor models and shrinkage. Recent work of Ledoit and Wolf has extended the shrinkage framework to Nonlinear Shrinkage (NLS), a more powerful covariance estimator based on Random Matrix Theory. Our contribution shows that, contrary to claims in the literature, cross-validation based covariance matrix estimation (CVC) yields comparable performance at strongly reduced complexity and runtime. On two real world data sets, we show that the CVC estimator yields superior results than competing shrinkage and factor based methods.

READ FULL TEXT

page 11

page 13

research
02/25/2022

An Improvement on the Hotelling T^2 Test Using the Ledoit-Wolf Nonlinear Shrinkage Estimator

Hotelling's T^2 test is a classical approach for discriminating the mean...
research
09/05/2021

James-Stein estimation of the first principal component

The Stein paradox has played an influential role in the field of high di...
research
09/01/2021

Multi Anchor Point Shrinkage for the Sample Covariance Matrix (Extended Version)

Portfolio managers faced with limited sample sizes must use factor model...
research
12/10/2020

Large Non-Stationary Noisy Covariance Matrices: A Cross-Validation Approach

We introduce a novel covariance estimator that exploits the heteroscedas...
research
07/03/2021

Cleaning large-dimensional covariance matrices for correlated samples

A non-linear shrinkage estimator of large-dimensional covariance matrice...
research
10/19/2018

Linear Shrinkage Estimation of Covariance Matrices Using Low-Complexity Cross-Validation

Shrinkage can effectively improve the condition number and accuracy of c...
research
02/27/2023

The Local Ledoit-Peche Law

Ledoit and Peche proved convergence of certain functions of a random cov...

Please sign up or login with your details

Forgot password? Click here to reset