High-dimensional covariance matrix estimation using a low-rank and diagonal decomposition

02/16/2018
by   Yilei Wu, et al.
0

We study high-dimensional covariance/precision matrix estimation under the assumption that the covariance/precision matrix can be decomposed into a low-rank component L and a diagonal component D. The rank of L can either be chosen to be small or controlled by a penalty function. Under moderate conditions on the population covariance/precision matrix itself and on the penalty function, we prove some consistency results for our estimators. A blockwise coordinate descent algorithm, which iteratively updates L and D, is then proposed to obtain the estimator in practice. Finally, various numerical experiments are presented: using simulated data, we show that our estimator performs quite well in terms of the Kullback-Leibler loss; using stock return data, we show that our method can be applied to obtain enhanced solutions to the Markowitz portfolio selection problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/30/2019

Block-diagonal covariance estimation and application to the Shapley effects in sensitivity analysis

In this paper, we aim to estimate block-diagonal covariance matrices for...
research
12/13/2018

Higher Moment Estimation for Elliptically-distributed Data: Is it Necessary to Use a Sledgehammer to Crack an Egg?

Multivariate elliptically-contoured distributions are widely used for mo...
research
04/18/2023

Low-rank covariance matrix estimation for factor analysis in anisotropic noise: application to array processing and portfolio selection

Factor analysis (FA) or principal component analysis (PCA) models the co...
research
06/17/2021

An efficient parallel block coordinate descent algorithm for large-scale precision matrix estimation using graphics processing units

Large-scale sparse precision matrix estimation has attracted wide intere...
research
01/18/2018

Computation of the Maximum Likelihood estimator in low-rank Factor Analysis

Factor analysis, a classical multivariate statistical technique is popul...
research
08/05/2020

FRMDN: Flow-based Recurrent Mixture Density Network

Recurrent Mixture Density Networks (RMDNs) are consisted of two main par...
research
06/05/2018

Combining covariance tapering and lasso driven low rank decomposition for the kriging of large spatial datasets

Large spatial datasets are becoming ubiquitous in environmental sciences...

Please sign up or login with your details

Forgot password? Click here to reset