Sparse Inverse Covariance Estimation via an Adaptive Gradient-Based Method

06/25/2011
by   Suvrit Sra, et al.
0

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is numerically very challenging. We address this challenge by developing a new adaptive gradient-based method that carefully combines gradient information with an adaptive step-scaling strategy, which results in a scalable, highly competitive method. Our algorithm, like its predecessors, maximizes an ℓ_1-norm penalized log-likelihood and has the same per iteration arithmetic complexity as the best methods in its class. Our experiments reveal that our approach outperforms state-of-the-art competitors, often significantly so, for large problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/05/2010

Split Bregman Method for Sparse Inverse Covariance Estimation with Matrix Iteration Acceleration

We consider the problem of estimating the inverse covariance matrix by m...
research
06/19/2019

Learning Directed Graphical Models from Gaussian Data

In this paper, we introduce two new directed graphical models from Gauss...
research
11/16/2018

A Novel Approach to Sparse Inverse Covariance Estimation Using Transform Domain Updates and Exponentially Adaptive Thresholding

Sparse Inverse Covariance Estimation (SICE) is useful in many practical ...
research
09/09/2021

A Proximal Distance Algorithm for Likelihood-Based Sparse Covariance Estimation

This paper addresses the task of estimating a covariance matrix under a ...
research
05/20/2021

EiGLasso for Scalable Sparse Kronecker-Sum Inverse Covariance Estimation

In many real-world problems, complex dependencies are present both among...
research
09/11/2022

Large covariance matrix estimation via penalized log-det heuristics

This paper provides a comprehensive estimation framework for large covar...
research
05/03/2016

Efficient Distributed Estimation of Inverse Covariance Matrices

In distributed systems, communication is a major concern due to issues s...

Please sign up or login with your details

Forgot password? Click here to reset