High-dimensional covariance estimation based on Gaussian graphical models

09/02/2010
by   Shuheng Zhou, et al.
0

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using ℓ_1-penalization methods. We propose and study the following method. We combine a multiple regression approach with ideas of thresholding and refitting: first we infer a sparse undirected graphical model structure via thresholding of each among many ℓ_1-norm penalized regression functions; we then estimate the covariance matrix and its inverse using the maximum likelihood estimator. We show that under suitable conditions, this approach yields consistent estimation in terms of graphical structure and fast convergence rates with respect to the operator and Frobenius norm for the covariance matrix and its inverse. We also derive an explicit bound for the Kullback Leibler divergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/19/2019

Learning Directed Graphical Models from Gaussian Data

In this paper, we introduce two new directed graphical models from Gauss...
research
02/22/2019

A permutation-based Bayesian approach for inverse covariance estimation

Covariance estimation and selection for multivariate datasets in a high-...
research
09/23/2012

Gemini: Graph estimation with matrix variate normal instances

Undirected graphs can be used to describe matrix variate distributions. ...
research
11/16/2018

A Novel Approach to Sparse Inverse Covariance Estimation Using Transform Domain Updates and Exponentially Adaptive Thresholding

Sparse Inverse Covariance Estimation (SICE) is useful in many practical ...
research
04/03/2012

Convergence Properties of Kronecker Graphical Lasso Algorithms

This paper studies iteration convergence of Kronecker graphical lasso (K...
research
06/27/2012

High-Dimensional Covariance Decomposition into Sparse Markov and Independence Domains

In this paper, we present a novel framework incorporating a combination ...
research
02/20/2008

Time Varying Undirected Graphs

Undirected graphs are often used to describe high dimensional distributi...

Please sign up or login with your details

Forgot password? Click here to reset