Deep State-Space Gaussian Processes

by   Zheng Zhao, et al.

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic differential equations (SDEs), where each SDE corresponds to a conditional GP. The DGP regression problem then becomes a state estimation problem, and we can estimate the state efficiently with sequential methods by using the Markov property of the state-space DGP. The computational complexity scales linearly with respect to the number of measurements. Based on this, we formulate state-space MAP as well as Bayesian filtering and smoothing solutions to the DGP regression problem. We demonstrate the performance of the proposed models and methods on synthetic non-stationary signals and apply the state-space DGP to detection of the gravitational waves from LIGO measurements.



page 14

page 17

page 18

page 19


State-space deep Gaussian processes with applications

This thesis is mainly concerned with state-space approaches for solving ...

Probabilistic Solutions To Ordinary Differential Equations As Non-Linear Bayesian Filtering: A New Perspective

We formulate probabilistic numerical approximations to solutions of ordi...

State Space Gaussian Processes with Non-Gaussian Likelihood

We provide a comprehensive overview and tooling for GP modeling with non...

Gaussian Process Kernels for Popular State-Space Time Series Models

In this paper we investigate a link between state- space models and Gaus...

The Lévy State Space Model

In this paper we introduce a new class of state space models based on sh...

Bayesian Inference for Stationary Points in Gaussian Process Regression Models for Event-Related Potentials Analysis

Stationary points embedded in the derivatives are often critical for a m...

Traversing Time with Multi-Resolution Gaussian Process State-Space Models

Gaussian Process state-space models capture complex temporal dependencie...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.