Deep Recurrent Gaussian Process with Variational Sparse Spectrum Approximation

11/02/2017
by   Roman Föll, et al.
0

Modeling sequential data has become more and more important in practice. Some applications are autonomous driving, virtual sensors and weather forecasting. To model such systems so called recurrent models are used. In this article we introduce two new Deep Recurrent Gaussian Process (DRGP) models based on the Sparse Spectrum Gaussian Process (SSGP) and the improved variational version called Variational Sparse Spectrum Gaussian Process (VSSGP). We follow the recurrent structure given by an existing DRGP based on a specific sparse Nyström approximation. Therefore, we also variationally integrate out the input-space and hence can propagate uncertainty through the layers. We can show that for the resulting lower bound an optimal variational distribution exists. Training is realized through optimizing the variational lower bound. Using Distributed Variational Inference (DVI), we can reduce the computational complexity. We improve over current state of the art methods in prediction accuracy for experimental data-sets used for their evaluation and introduce a new data-set for engine control, named Emission. Furthermore, our method can easily be adapted for unsupervised learning, e.g. the latent variable model and its deep version.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2022

Generalised Gaussian Process Latent Variable Models (GPLVM) with Stochastic Variational Inference

Gaussian process latent variable models (GPLVM) are a flexible and non-l...
research
10/15/2019

The Rényi Gaussian Process

In this article we introduce an alternative closed form lower bound on t...
research
03/09/2015

Improving the Gaussian Process Sparse Spectrum Approximation by Representing Uncertainty in Frequency Inputs

Standard sparse pseudo-input approximations to the Gaussian process (GP)...
research
03/12/2018

Variational Inference for Gaussian Process with Panel Count Data

We present the first framework for Gaussian-process-modulated Poisson pr...
research
11/05/2021

Dual Parameterization of Sparse Variational Gaussian Processes

Sparse variational Gaussian process (SVGP) methods are a common choice f...
research
02/06/2014

Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models - a Gentle Tutorial

In this tutorial we explain the inference procedures developed for the s...
research
03/28/2023

Sparse Gaussian Processes with Spherical Harmonic Features Revisited

We revisit the Gaussian process model with spherical harmonic features a...

Please sign up or login with your details

Forgot password? Click here to reset