Sparse within Sparse Gaussian Processes using Neighbor Information

11/10/2020
by   Gia-Lac Tran, et al.
0

Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address one limitation of sparse GPs, which is due to the challenge in dealing with a large number of inducing variables without imposing a special structure on the inducing inputs. In particular, we introduce a novel hierarchical prior, which imposes sparsity on the set of inducing variables. We treat our model variationally, and we experimentally show considerable computational gains compared to standard sparse GPs when sparsity on the inducing variables is realized considering the nearest inducing inputs of a random mini-batch of the data. We perform an extensive experimental validation that demonstrates the effectiveness of our approach compared to the state-of-the-art. Our approach enables the possibility to use sparse GPs using a large number of inducing points without incurring a prohibitive computational cost.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2021

Input Dependent Sparse Gaussian Processes

Gaussian Processes (GPs) are Bayesian models that provide uncertainty es...
research
04/11/2023

Actually Sparse Variational Gaussian Processes

Gaussian processes (GPs) are typically criticised for their unfavourable...
research
05/28/2019

Recursive Estimation for Sparse Gaussian Process Regression

Gaussian Processes (GPs) are powerful kernelized methods for non-paramet...
research
07/06/2018

Fully Scalable Gaussian Processes using Subspace Inducing Inputs

We introduce fully scalable Gaussian processes, an implementation scheme...
research
05/10/2021

SigGPDE: Scaling Sparse Gaussian Processes on Sequential Data

Making predictions and quantifying their uncertainty when the input data...
research
07/14/2020

Towards Credit-Fraud Detection via Sparsely Varying Gaussian Approximations

Fraudulent activities are an expensive problem for many financial instit...
research
04/27/2023

Spherical Inducing Features for Orthogonally-Decoupled Gaussian Processes

Despite their many desirable properties, Gaussian processes (GPs) are of...

Please sign up or login with your details

Forgot password? Click here to reset