Covariance estimation with uniform blocks

02/03/2023
by   Yifan Yang, et al.
0

Estimating a covariance matrix is central to high-dimensional data analysis. The proposed method is motivated by the dependence pattern analyses of multiple types of high-dimensional biomedical data including but not limited to genomics, proteomics, microbiome, and neuroimaging data. The correlation matrices of these biomedical data all demonstrate a well-organized block pattern. In this pattern, the positive and negative pair-wise correlations with large absolute values, are mainly concentrated within diagonal and off-diagonal blocks. We develop a covariance- and precision-matrix estimation framework to fully leverage the organized block pattern. We propose new best unbiased covariance- and precision-matrix estimators in closed forms, and develop theories for the asymptotic proprieties of estimators in both scenarios where the number of blocks is less or greater than the sample size. The simulation and data example analyses show that our method is robust and improves the accuracy of covariance- and precision-matrix estimation.

READ FULL TEXT

page 4

page 23

page 35

research
12/13/2018

Higher Moment Estimation for Elliptically-distributed Data: Is it Necessary to Use a Sledgehammer to Crack an Egg?

Multivariate elliptically-contoured distributions are widely used for mo...
research
03/22/2022

On block-wise and reference panel-based estimators for genetic data prediction in high dimensions

Genetic prediction of complex traits and diseases has attracted enormous...
research
04/17/2023

A New Representation of Uniform-Block Matrix and Applications

A covariance matrix with a special pattern (e.g., sparsity or block stru...
research
04/07/2022

Fast estimation of Kendall's Tau and conditional Kendall's Tau matrices under structural assumptions

Kendall's tau and conditional Kendall's tau matrices are multivariate (c...
research
05/31/2020

Estimation of the number of spiked eigenvalues in a covariance matrix by bulk eigenvalue matching analysis

The spiked covariance model has gained increasing popularity in high-dim...
research
12/30/2022

Two-step estimators of high dimensional correlation matrices

We investigate block diagonal and hierarchical nested stochastic multiva...
research
11/06/2017

Asymptotics for high-dimensional covariance matrices and quadratic forms with applications to the trace functional and shrinkage

We establish large sample approximations for an arbitray number of bilin...

Please sign up or login with your details

Forgot password? Click here to reset