Estimation of positive definite M-matrices and structure learning for attractive Gaussian Markov Random fields

04/26/2014
by   Martin Slawski, et al.
0

Consider a random vector with finite second moments. If its precision matrix is an M-matrix, then all partial correlations are non-negative. If that random vector is additionally Gaussian, the corresponding Markov random field (GMRF) is called attractive. We study estimation of M-matrices taking the role of inverse second moment or precision matrices using sign-constrained log-determinant divergence minimization. We also treat the high-dimensional case with the number of variables exceeding the sample size. The additional sign-constraints turn out to greatly simplify the estimation problem: we provide evidence that explicit regularization is no longer required. To solve the resulting convex optimization problem, we propose an algorithm based on block coordinate descent, in which each sub-problem can be recast as non-negative least squares problem. Illustrations on both simulated and real world data are provided.

READ FULL TEXT
research
07/30/2020

Covariance estimation with nonnegative partial correlations

We study the problem of high-dimensional covariance estimation under the...
research
03/01/2020

Estimating Multiple Precision Matrices with Cluster Fusion Regularization

We propose a penalized likelihood framework for estimating multiple prec...
research
03/24/2021

Characterizing total negativity and testing their interval hulls

A matrix is called totally negative (totally non-positive) of order k, i...
research
04/24/2017

Entropic Trace Estimates for Log Determinants

The scalable calculation of matrix determinants has been a bottleneck to...
research
05/04/2012

Non-negative least squares for high-dimensional linear models: consistency and sparse recovery without regularization

Least squares fitting is in general not useful for high-dimensional line...
research
09/18/2023

Learning Covariances for Estimation with Constrained Bilevel Optimization

We consider the problem of learning error covariance matrices for roboti...
research
01/05/2022

On the finiteness of the second moment of the number of critical points of Gaussian random fields

We prove that the second moment of the number of critical points of any ...

Please sign up or login with your details

Forgot password? Click here to reset