Estimating covariance and precision matrices along subspaces

09/26/2019
by   Zeljko Kereta, et al.
0

We study the accuracy of estimating the covariance and the precision matrix of a D-variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance with N ≥ D samples. Our results show that the estimation accuracy depends almost exclusively only on the components of the distribution that correspond to desired subspaces or directions. This is relevant for problems where behavior of data along a lower-dimensional space is of specific interest, such as dimension reduction or structured regression problems. As a by-product of the analysis, we reduce the effect the matrix condition number has on the estimation of precision matrices. Two applications are presented: direction-sensitive eigenspace perturbation bounds, and estimation of the single-index model. For the latter, a new estimator, derived from the analysis, with strong theoretical guarantees and superior numerical performance is proposed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2020

Covariance Estimation for Matrix-valued Data

Covariance estimation for matrix-valued data has received an increasing ...
research
05/12/2016

Subspace Perspective on Canonical Correlation Analysis: Dimension Reduction and Minimax Rates

Canonical correlation analysis (CCA) is a fundamental statistical tool f...
research
10/08/2018

Find the dimension that counts: Fast dimension estimation and Krylov PCA

High dimensional data and systems with many degrees of freedom are often...
research
05/08/2018

Optimal Subspace Estimation Using Overidentifying Vectors via Generalized Method of Moments

Many statistical models seek relationship between variables via subspace...
research
05/17/2023

Flagfolds

By interpreting the product of the Principal Component Analysis, that is...
research
04/20/2019

Stationary subspace analysis of nonstationary covariance processes: eigenstructure description and testing

Stationary subspace analysis (SSA) searches for linear combinations of t...
research
10/27/2018

On the role of ML estimation and Bregman divergences in sparse representation of covariance and precision matrices

Sparse representation of structured signals requires modelling strategie...

Please sign up or login with your details

Forgot password? Click here to reset