Structured Variational Inference in Unstable Gaussian Process State Space Models

07/16/2019
by   Silvan Melchior, et al.
2

Gaussian processes are expressive, non-parametric statistical models that are well-suited to learn nonlinear dynamical systems. However, large-scale inference in these state space models is a challenging problem. In this paper, we propose CBF-SSM a scalable model that employs a structured variational approximation to maintain temporal correlations. In contrast to prior work, our approach applies to the important class of unstable systems, where state uncertainty grows unbounded over time. For these systems, our method contains a probabilistic, model-based backward pass that infers latent states during training. We demonstrate state-of-the-art performance in our experiments. Moreover, we show that CBF-SSM can be combined with physical models in the form of ordinary differential equations to learn a reliable model of a physical flying robotic vehicle.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2018

Probabilistic Recurrent State-Space Models

State-space models (SSMs) are a highly expressive model class for learni...
research
06/10/2021

Compositional Modeling of Nonlinear Dynamical Systems with ODE-based Random Features

Effectively modeling phenomena present in highly nonlinear dynamical sys...
research
06/14/2023

Deep Gaussian Markov Random Fields for Graph-Structured Dynamical Systems

Probabilistic inference in high-dimensional state-space models is comput...
research
02/17/2019

ODIN: ODE-Informed Regression for Parameter and State Inference in Time-Continuous Dynamical Systems

Parameter inference in ordinary differential equations is an important p...
research
12/06/2021

Traversing Time with Multi-Resolution Gaussian Process State-Space Models

Gaussian Process state-space models capture complex temporal dependencie...
research
12/28/2019

The Lévy State Space Model

In this paper we introduce a new class of state space models based on sh...
research
09/30/2022

Φ-DVAE: Learning Physically Interpretable Representations with Nonlinear Filtering

Incorporating unstructured data into physical models is a challenging pr...

Please sign up or login with your details

Forgot password? Click here to reset