DeepAI AI Chat
Log In Sign Up

Identification of Gaussian Process State Space Models

by   Stefanos Eleftheriadis, et al.

The Gaussian process state space model (GPSSM) is a non-linear dynamical system, where unknown transition and/or measurement mappings are described by GPs. Most research in GPSSMs has focussed on the state estimation problem, i.e., computing a posterior of the latent state given the model. However, the key challenge in GPSSMs has not been satisfactorily addressed yet: system identification, i.e., learning the model. To address this challenge, we impose a structured Gaussian variational posterior distribution over the latent states, which is parameterised by a recognition model in the form of a bi-directional recurrent neural network. Inference with this structure allows us to recover a posterior smoothed over sequences of data. We provide a practical algorithm for efficiently computing a lower bound on the marginal likelihood using the reparameterisation trick. This further allows for the use of arbitrary kernels within the GPSSM. We demonstrate that the learnt GPSSM can efficiently generate plausible future trajectories of the identified system after only observing a small number of episodes from the true system.


page 1

page 2

page 3

page 4


Structured Inference Networks for Nonlinear State Space Models

Gaussian state space models have been used for decades as generative mod...

Closed-form Inference and Prediction in Gaussian Process State-Space Models

We examine an analytic variational inference scheme for the Gaussian Pro...

Overcoming Mean-Field Approximations in Recurrent Gaussian Process Models

We identify a new variational inference scheme for dynamical systems who...

The Rényi Gaussian Process

In this article we introduce an alternative closed form lower bound on t...

Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference

This paper presents a fast algorithm for estimating hidden states of Bay...

Ensemble Rejection Sampling

We introduce Ensemble Rejection Sampling, a scheme for exact simulation ...

Output-Dependent Gaussian Process State-Space Model

Gaussian process state-space model (GPSSM) is a fully probabilistic stat...