Deep Gaussian Markov Random Fields for Graph-Structured Dynamical Systems

06/14/2023
by   Fiona Lippert, et al.
0

Probabilistic inference in high-dimensional state-space models is computationally challenging. For many spatiotemporal systems, however, prior knowledge about the dependency structure of state variables is available. We leverage this structure to develop a computationally efficient approach to state estimation and learning in graph-structured state-space models with (partially) unknown dynamics and limited historical data. Building on recent methods that combine ideas from deep learning with principled inference in Gaussian Markov random fields (GMRF), we reformulate graph-structured state-space models as Deep GMRFs defined by simple spatial and temporal graph layers. This results in a flexible spatiotemporal prior that can be learned efficiently from a single time sequence via variational inference. Under linear Gaussian assumptions, we retain a closed-form posterior, which can be sampled efficiently using the conjugate gradient method, scaling favourably compared to classical Kalman filter based approaches

READ FULL TEXT
research
11/23/2015

Black box variational inference for state space models

Latent variable time-series models are among the most heavily used tools...
research
07/16/2019

Structured Variational Inference in Unstable Gaussian Process State Space Models

Gaussian processes are expressive, non-parametric statistical models tha...
research
06/10/2022

Scalable Deep Gaussian Markov Random Fields for General Graphs

Machine learning methods on graphs have proven useful in many applicatio...
research
02/26/2019

Banded Matrix Operators for Gaussian Markov Models in the Automatic Differentiation Era

Banded matrices can be used as precision matrices in several models incl...
research
02/18/2020

Deep Gaussian Markov random fields

Gaussian Markov random fields (GMRFs) are probabilistic graphical models...
research
12/21/2021

Efficient Estimation of State-Space Mixed-Frequency VARs: A Precision-Based Approach

State-space mixed-frequency vector autoregressions are now widely used f...
research
05/02/2023

Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systems

Graph neural networks are often used to model interacting dynamical syst...

Please sign up or login with your details

Forgot password? Click here to reset