Information Geometry and Asymptotics for Kronecker Covariances

08/04/2023
by   Andrew McCormack, et al.
0

We explore the information geometry and asymptotic behaviour of estimators for Kronecker-structured covariances, in both growing-n and growing-p scenarios, with a focus towards examining the quadratic form or partial trace estimator proposed by Linton and Tang. It is shown that the partial trace estimator is asymptotically inefficient An explanation for this inefficiency is that the partial trace estimator does not scale sub-blocks of the sample covariance matrix optimally. To correct for this, an asymptotically efficient, rescaled partial trace estimator is proposed. Motivated by this rescaling, we introduce an orthogonal parameterization for the set of Kronecker covariances. High-dimensional consistency results using the partial trace estimator are obtained that demonstrate a blessing of dimensionality. In settings where an array has at least order three, it is shown that as the array dimensions jointly increase, it is possible to consistently estimate the Kronecker covariance matrix, even when the sample size is one.

READ FULL TEXT
research
09/27/2022

Improved covariance estimation: optimal robustness and sub-Gaussian guarantees under heavy tails

We present an estimator of the covariance matrix Σ of random d-dimension...
research
09/03/2018

Shrinkage for Covariance Estimation: Asymptotics, Confidence Intervals, Bounds and Applications in Sensor Monitoring and Finance

When shrinking a covariance matrix towards (a multiple) of the identity ...
research
06/21/2019

Estimation of the Kronecker Covariance Model by Partial Means and Quadratic Form

We propose two new estimators of the Kronecker product model of the cova...
research
09/10/2023

Hutchinson's Estimator is Bad at Kronecker-Trace-Estimation

We study the problem of estimating the trace of a matrix 𝐀 that can only...
research
02/19/2021

Cross-Validated Loss-Based Covariance Matrix Estimator Selection in High Dimensions

The covariance matrix plays a fundamental role in many modern explorator...
research
10/10/2022

Approximating Partial Likelihood Estimators via Optimal Subsampling

With the growing availability of large-scale biomedical data, it is ofte...
research
08/10/2022

Trace Moments of the Sample Covariance Matrix with Graph-Coloring

Let S_p,n denote the sample covariance matrix based on n independent ide...

Please sign up or login with your details

Forgot password? Click here to reset