Constant-Time Predictive Distributions for Gaussian Processes

03/16/2018
by   Geoff Pleiss, et al.
0

One of the most compelling features of Gaussian process (GP) regression is its ability to provide well calibrated posterior distributions. Recent advances in inducing point methods have drastically sped up marginal likelihood and posterior mean computations, leaving posterior covariance estimation and sampling as the remaining computational bottlenecks. In this paper we address this shortcoming by using the Lanczos decomposition algorithm to rapidly approximate the predictive covariance matrix. Our approach, which we refer to as LOVE (LanczOs Variance Estimates), substantially reduces the time and space complexity over any previous method. In practice, it can compute predictive covariances up to 2,000 times faster and draw samples 18,000 time faster than existing methods, all without sacrificing accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2015

MCMC for Variationally Sparse Gaussian Processes

Gaussian process (GP) models form a core part of probabilistic machine l...
research
10/16/2019

Sparse Gaussian Process Regression Beyond Variational Inference

The combination of inducing point methods with stochastic variational in...
research
05/28/2019

Recursive Estimation for Sparse Gaussian Process Regression

Gaussian Processes (GPs) are powerful kernelized methods for non-paramet...
research
05/30/2022

Posterior and Computational Uncertainty in Gaussian Processes

Gaussian processes scale prohibitively with the size of the dataset. In ...
research
01/22/2015

Enabling scalable stochastic gradient-based inference for Gaussian processes by employing the Unbiased LInear System SolvEr (ULISSE)

In applications of Gaussian processes where quantification of uncertaint...
research
10/14/2021

Sparse Implicit Processes for Approximate Inference

Implicit Processes (IPs) are flexible priors that can describe models su...
research
02/23/2023

Sharp Calibrated Gaussian Processes

While Gaussian processes are a mainstay for various engineering and scie...

Please sign up or login with your details

Forgot password? Click here to reset