Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)

03/03/2015
by   Andrew Gordon Wilson, et al.
0

We introduce a new structured kernel interpolation (SKI) framework, which generalises and unifies inducing point methods for scalable Gaussian processes (GPs). SKI methods produce kernel approximations for fast computations through kernel interpolation. The SKI framework clarifies how the quality of an inducing point approach depends on the number of inducing (aka interpolation) points, interpolation strategy, and GP covariance kernel. SKI also provides a mechanism to create new scalable kernel methods, through choosing different kernel interpolation strategies. Using SKI, with local cubic kernel interpolation, we introduce KISS-GP, which is 1) more scalable than inducing point alternatives, 2) naturally enables Kronecker and Toeplitz algebra for substantial additional gains in scalability, without requiring any grid data, and 3) can be used for fast and expressive kernel learning. KISS-GP costs O(n) time and storage for GP inference. We evaluate KISS-GP for kernel matrix approximation, kernel learning, and natural sound modelling.

READ FULL TEXT
research
06/12/2021

SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processes

State-of-the-art methods for scalable Gaussian processes use iterative a...
research
11/05/2015

Thoughts on Massively Scalable Gaussian Processes

We introduce a framework and early results for massively scalable Gaussi...
research
01/28/2021

Faster Kernel Interpolation for Gaussian Processes

A key challenge in scaling Gaussian Process (GP) regression to massive d...
research
02/28/2021

Hierarchical Inducing Point Gaussian Process for Inter-domain Observations

We examine the general problem of inter-domain Gaussian Processes (GPs):...
research
01/31/2018

Kernel Distillation for Gaussian Processes

Gaussian processes (GPs) are flexible models that can capture complex st...
research
03/02/2021

Kernel Interpolation for Scalable Online Gaussian Processes

Gaussian processes (GPs) provide a gold standard for performance in onli...
research
08/28/2020

Locally induced Gaussian processes for large-scale simulation experiments

Gaussian processes (GPs) serve as flexible surrogates for complex surfac...

Please sign up or login with your details

Forgot password? Click here to reset