Non-Stationary Gaussian Process Regression with Hamiltonian Monte Carlo

08/18/2015
by   Markus Heinonen, et al.
0

We present a novel approach for fully non-stationary Gaussian process regression (GPR), where all three key parameters -- noise variance, signal variance and lengthscale -- can be simultaneously input-dependent. We develop gradient-based inference methods to learn the unknown function and the non-stationary model parameters, without requiring any model approximations. We propose to infer full parameter posterior with Hamiltonian Monte Carlo (HMC), which conveniently extends the analytical gradient-based GPR learning by guiding the sampling with model gradients. We also learn the MAP solution from the posterior by gradient ascent. In experiments on several synthetic datasets and in modelling of temporal gene expression, the nonstationary GPR is shown to be necessary for modeling realistic input-dependent dynamics, while it performs comparably to conventional stationary or previous non-stationary GPR models otherwise.

READ FULL TEXT
research
05/24/2017

Non-Stationary Spectral Kernels

We propose non-stationary spectral kernels for Gaussian process regressi...
research
06/25/2019

Prediction Using a Bayesian Heteroscedastic Composite Gaussian Process

This research proposes a flexible Bayesian extension of the composite Ga...
research
10/13/2019

Nonstationary Multivariate Gaussian Processes for Electronic Health Records

We propose multivariate nonstationary Gaussian processes for jointly mod...
research
04/22/2014

Approximate Inference for Nonstationary Heteroscedastic Gaussian process Regression

This paper presents a novel approach for approximate integration over th...
research
06/11/2022

Gradient Boosting Performs Low-Rank Gaussian Process Inference

This paper shows that gradient boosting based on symmetric decision tree...
research
07/09/2015

Intrinsic Non-stationary Covariance Function for Climate Modeling

Designing a covariance function that represents the underlying correlati...
research
03/08/2022

Bayesian Calibration for Activity Based Models

We consider the problem of calibration and uncertainty analysis for acti...

Please sign up or login with your details

Forgot password? Click here to reset