Adaptive Cholesky Gaussian Processes

02/22/2022
by   Simon Bartels, et al.
3

We present a method to fit exact Gaussian process models to large datasets by considering only a subset of the data. Our approach is novel in that the size of the subset is selected on the fly during exact inference with little computational overhead. From an empirical observation that the log-marginal likelihood often exhibits a linear trend once a sufficient subset of a dataset has been observed, we conclude that many large datasets contain redundant information that only slightly affects the posterior. Based on this, we provide probabilistic bounds on the full model evidence that can identify such subsets. Remarkably, these bounds are largely composed of terms that appear in intermediate steps of the standard Cholesky decomposition, allowing us to modify the algorithm to adaptively stop the decomposition once enough data have been observed. Empirically, we show that our method can be directly plugged into well-known inference schemes to fit exact Gaussian process models to large datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2021

Inverse Gaussian Process regression for likelihood-free inference

In this work we consider Bayesian inference problems with intractable li...
research
11/14/2019

Conjugate Gradients for Kernel Machines

Regularized least-squares (kernel-ridge / Gaussian process) regression i...
research
09/27/2018

Adaptive Gaussian process surrogates for Bayesian inference

We present an adaptive approach to the construction of Gaussian process ...
research
04/03/2020

Faster Gaussian Processes via Deep Embeddings

Gaussian processes provide a probabilistic framework for quantifying unc...
research
06/22/2017

Scalable Multi-Class Gaussian Process Classification using Expectation Propagation

This paper describes an expectation propagation (EP) method for multi-cl...
research
06/15/2016

Understanding Probabilistic Sparse Gaussian Process Approximations

Good sparse approximations are essential for practical inference in Gaus...
research
12/31/2021

When are Iterative Gaussian Processes Reliably Accurate?

While recent work on conjugate gradient methods and Lanczos decompositio...

Please sign up or login with your details

Forgot password? Click here to reset