GraphIT: Iterative reweighted ℓ_1 algorithm for sparse graph inference in state-space models

03/22/2023
by   Emilie Chouzenoux, et al.
0

State-space models (SSMs) are a common tool for modeling multi-variate discrete-time signals. The linear-Gaussian (LG) SSM is widely applied as it allows for a closed-form solution at inference, if the model parameters are known. However, they are rarely available in real-world problems and must be estimated. Promoting sparsity of these parameters favours both interpretability and tractable inference. In this work, we propose GraphIT, a majorization-minimization (MM) algorithm for estimating the linear operator in the state equation of an LG-SSM under sparse prior. A versatile family of non-convex regularization potentials is proposed. The MM method relies on tools inherited from the expectation-maximization methodology and the iterated reweighted-l1 approach. In particular, we derive a suitable convex upper bound for the objective function, that we then minimize using a proximal splitting algorithm. Numerical experiments illustrate the benefits of the proposed inference technique.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2020

GraphEM: EM algorithm for blind Kalman filtering under graphical sparsity constraints

Modeling and inference with multivariate sequences is central in a numbe...
research
07/20/2023

Graphs in State-Space Models for Granger Causality in Climate Science

Granger causality (GC) is often considered not an actual form of causali...
research
06/20/2023

Sparse Bayesian Estimation of Parameters in Linear-Gaussian State-Space Models

State-space models (SSMs) are a powerful statistical tool for modelling ...
research
09/20/2022

Graphical Inference in Linear-Gaussian State-Space Models

State-space models (SSM) are central to describe time-varying complex sy...
research
05/10/2020

Topological regularization with information filtering networks

A methodology to perform topological regularization via information filt...
research
06/25/2015

Generalized Majorization-Minimization

Non-convex optimization is ubiquitous in machine learning. The Majorizat...
research
02/06/2022

Learning Sparse Graphs via Majorization-Minimization for Smooth Node Signals

In this letter, we propose an algorithm for learning a sparse weighted g...

Please sign up or login with your details

Forgot password? Click here to reset