Inference for Sparse Conditional Precision Matrices

12/24/2014
by   Jialei Wang, et al.
0

Given n i.i.d. observations of a random vector (X,Z), where X is a high-dimensional vector and Z is a low-dimensional index variable, we study the problem of estimating the conditional inverse covariance matrix Ω(z) = (E[(X-E[X | Z])(X-E[X | Z])^T | Z=z])^-1 under the assumption that the set of non-zero elements is small and does not depend on the index variable. We develop a novel procedure that combines the ideas of the local constant smoothing and the group Lasso for estimating the conditional inverse covariance matrix. A proximal iterative smoothing algorithm is used to solve the corresponding convex optimization problems. We prove that our procedure recovers the conditional independence assumptions of the distribution X | Z with high probability. This result is established by developing a uniform deviation bound for the high-dimensional conditional covariance matrix from its population counterpart, which may be of independent interest. Furthermore, we develop point-wise confidence intervals for individual elements of the conditional inverse covariance matrix. We perform extensive simulation studies, in which we demonstrate that our proposed procedure outperforms sensible competitors. We illustrate our proposal on a S&P 500 stock price data set.

READ FULL TEXT

page 21

page 22

research
05/14/2021

Robust Estimation of Sparse Precision Matrix using Adaptive Weighted Graphical Lasso Approach

Estimation of a precision matrix (i.e., inverse covariance matrix) is wi...
research
01/31/2018

De-biased sparse PCA: Inference and testing for eigenstructure of large covariance matrices

Sparse principal component analysis (sPCA) has become one of the most wi...
research
08/25/2022

On confidence intervals for precision matrices and the eigendecomposition of covariance matrices

The eigendecomposition of a matrix is the central procedure in probabili...
research
05/18/2021

High-Dimensional Sparse Single-Index Regression Via Hilbert-Schmidt Independence Criterion

Hilbert-Schmidt Independence Criterion (HSIC) has recently been used in ...
research
12/29/2011

High-dimensional Sparse Inverse Covariance Estimation using Greedy Methods

In this paper we consider the task of estimating the non-zero pattern of...
research
06/30/2021

The geometry of Gaussian double Markovian distributions

Gaussian double Markovian models consist of covariance matrices constrai...
research
08/28/2021

Convergence of position-dependent MALA with application to conditional simulation in GLMMs

We establish verifiable conditions under which Metropolis-Hastings (MH) ...

Please sign up or login with your details

Forgot password? Click here to reset