DeepAI AI Chat
Log In Sign Up

Closed-form Inference and Prediction in Gaussian Process State-Space Models

by   Alessandro Davide Ialongo, et al.
University of Cambridge

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the system states and the transition function. We exploit Markov structure in the true posterior, as well as an inducing point approximation to achieve linear time complexity in the length of the time series. Contrary to previous approaches, no Monte Carlo sampling is required: inference is cast as a deterministic optimisation problem. In a number of experiments, we demonstrate the ability to model non-linear dynamics in the presence of both process and observation noise as well as to impute missing information (e.g. velocities from raw positions through time), to de-noise, and to estimate the underlying dimensionality of the system. Finally, we also introduce a closed-form method for multi-step prediction, and a novel criterion for assessing the quality of our approximate posterior.


page 1

page 2

page 3

page 4


Free-Form Variational Inference for Gaussian Process State-Space Models

Gaussian process state-space models (GPSSMs) provide a principled and fl...

Fast Variational Learning in State-Space Gaussian Process Models

Gaussian process (GP) regression with 1D inputs can often be performed i...

Identification of Gaussian Process State Space Models

The Gaussian process state space model (GPSSM) is a non-linear dynamical...

A Novel Variational Family for Hidden Nonlinear Markov Models

Latent variable models have been widely applied for the analysis and vis...

Safe Policy Search with Gaussian Process Models

We propose a method to optimise the parameters of a policy which will be...

Assessing Ecosystem State Space Models: Identifiability and Estimation

Bayesian methods are increasingly being applied to parameterize mechanis...

A Variational Bayesian State-Space Approach to Online Passive-Aggressive Regression

Online Passive-Aggressive (PA) learning is a class of online margin-base...