Efficient reduced-rank methods for Gaussian processes with eigenfunction expansions

08/12/2021
by   Philip Greengard, et al.
0

In this work we introduce a reduced-rank algorithm for Gaussian process regression. Our numerical scheme converts a Gaussian process on a user-specified interval to its Karhunen-Loève expansion, the L^2-optimal reduced-rank representation. Numerical evaluation of the Karhunen-Loève expansion is performed once during precomputation and involves computing a numerical eigendecomposition of an integral operator whose kernel is the covariance function of the Gaussian process. The Karhunen-Loève expansion is independent of observed data and depends only on the covariance kernel and the size of the interval on which the Gaussian process is defined. The scheme of this paper does not require translation invariance of the covariance kernel. We also introduce a class of fast algorithms for Bayesian fitting of hyperparameters, and demonstrate the performance of our algorithms with numerical experiments in one and two dimensions. Extensions to higher dimensions are mathematically straightforward but suffer from the standard curses of high dimensions.

READ FULL TEXT
research
01/21/2014

Hilbert Space Methods for Reduced-Rank Gaussian Process Regression

This paper proposes a novel scheme for reduced-rank Gaussian process reg...
research
07/28/2020

Effective computations of joint excursion times for stationary Gaussian processes

This work is to popularize the method of computing the distribution of t...
research
01/07/2021

Infinitely Wide Tensor Networks as Gaussian Process

Gaussian Process is a non-parametric prior which can be understood as a ...
research
08/22/2022

Scale invariant process regression

Gaussian processes are the leading method for non-parametric regression ...
research
12/31/2021

When are Iterative Gaussian Processes Reliably Accurate?

While recent work on conjugate gradient methods and Lanczos decompositio...
research
06/27/2012

Faster Gaussian Summation: Theory and Experiment

We provide faster algorithms for the problem of Gaussian summation, whic...
research
04/22/2015

On the relation between Gaussian process quadratures and sigma-point methods

This article is concerned with Gaussian process quadratures, which are n...

Please sign up or login with your details

Forgot password? Click here to reset