Conditioning Sparse Variational Gaussian Processes for Online Decision-making

10/28/2021
by   Wesley J. Maddox, et al.
0

With a principled representation of uncertainty and closed form posterior updates, Gaussian processes (GPs) are a natural choice for online decision making. However, Gaussian processes typically require at least 𝒪(n^2) computations for n training points, limiting their general applicability. Stochastic variational Gaussian processes (SVGPs) can provide scalable inference for a dataset of fixed size, but are difficult to efficiently condition on new data. We propose online variational conditioning (OVC), a procedure for efficiently conditioning SVGPs in an online setting that does not require re-training through the evidence lower bound with the addition of new data. OVC enables the pairing of SVGPs with advanced look-ahead acquisition functions for black-box optimization, even with non-Gaussian likelihoods. We show OVC provides compelling performance in a range of applications including active learning of malaria incidence, and reinforcement learning on MuJoCo simulated robotic control tasks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 24

03/02/2021

Kernel Interpolation for Scalable Online Gaussian Processes

Gaussian processes (GPs) provide a gold standard for performance in onli...
07/21/2021

Adaptive Inducing Points Selection For Gaussian Processes

Gaussian Processes (GPs) are flexible non-parametric models with strong ...
04/22/2022

A piece-wise constant approximation for non-conjugate Gaussian Process models

Gaussian Processes (GPs) are a versatile and popular method in Bayesian ...
11/19/2015

Variational Auto-encoded Deep Gaussian Processes

We develop a scalable deep non-parametric generative model by augmenting...
02/22/2022

Gaussian Processes and Statistical Decision-making in Non-Euclidean Spaces

Bayesian learning using Gaussian processes provides a foundational frame...
05/10/2021

SigGPDE: Scaling Sparse Gaussian Processes on Sequential Data

Making predictions and quantifying their uncertainty when the input data...
11/23/2021

Application of Gaussian Processes to online approximation of compressor maps for load-sharing in a compressor station

Devising optimal operating strategies for a compressor station relies on...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.