DeepAI AI Chat
Log In Sign Up

Learning Sparse Graph with Minimax Concave Penalty under Gaussian Markov Random Fields

by   Tatsuya Koyakumaru, et al.
Keio University

This paper presents a convex-analytic framework to learn sparse graphs from data. While our problem formulation is inspired by an extension of the graphical lasso using the so-called combinatorial graph Laplacian framework, a key difference is the use of a nonconvex alternative to the ℓ_1 norm to attain graphs with better interpretability. Specifically, we use the weakly-convex minimax concave penalty (the difference between the ℓ_1 norm and the Huber function) which is known to yield sparse solutions with lower estimation bias than ℓ_1 for regression problems. In our framework, the graph Laplacian is replaced in the optimization by a linear transform of the vector corresponding to its upper triangular part. Via a reformulation relying on Moreau's decomposition, we show that overall convexity is guaranteed by introducing a quadratic function to our cost function. The problem can be solved efficiently by the primal-dual splitting method, of which the admissible conditions for provable convergence are presented. Numerical examples show that the proposed method significantly outperforms the existing graph learning methods with reasonable CPU time.


page 2

page 3

page 4

page 5

page 6

page 8

page 10

page 11


Efficient Graph Laplacian Estimation by a Proximal Newton Approach

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a comm...

Learning Graph Laplacian with MCP

Motivated by the observation that the ability of the ℓ_1 norm in promoti...

Sparse Laplacian Shrinkage with the Graphical Lasso Estimator for Regression Problems

This paper considers a high-dimensional linear regression problem where ...

Regularization vs. Relaxation: A conic optimization perspective of statistical variable selection

Variable selection is a fundamental task in statistical data analysis. S...

Sparse-Group Log-Sum Penalized Graphical Model Learning For Time Series

We consider the problem of inferring the conditional independence graph ...

Kernel Regression for Graph Signal Prediction in Presence of Sparse Noise

In presence of sparse noise we propose kernel regression for predicting ...