Uncertainty quantification for sparse spectral variational approximations in Gaussian process regression

12/21/2022
by   Dennis Nieman, et al.
0

We investigate the frequentist properties of the variational sparse Gaussian Process regression model. In the theoretical analysis we focus on the variational approach with spectral features as inducing variables. We derive guarantees and limitations for the frequentist coverage of the resulting variational credible sets. We also derive sufficient and necessary lower bounds for the number of inducing variables required to achieve minimax posterior contraction rates. The implications of these results are demonstrated for different choices of priors. In a numerical analysis we consider a wider range of inducing variable methods and observe similar phenomena beyond the scope of our theoretical findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/22/2021

Contraction rates for sparse variational approximations in Gaussian process regression

We study the theoretical properties of a variational Bayes method in the...
research
05/16/2022

On the inability of Gaussian process regression to optimally learn compositional functions

We rigorously prove that deep Gaussian process priors can outperform Gau...
research
03/08/2019

Rates of Convergence for Sparse Variational Gaussian Process Regression

Excellent variational approximations to Gaussian process posteriors have...
research
11/07/2014

Scalable Variational Gaussian Process Classification

Gaussian process classification is a popular method with a number of app...
research
04/27/2015

On Sparse variational methods and the Kullback-Leibler divergence between stochastic processes

The variational framework for learning inducing variables (Titsias, 2009...
research
02/04/2020

On the Inference of Applying Gaussian Process Modeling to a Deterministic Function

The Gaussian process modeling is a standard tool for building emulators ...
research
07/16/2022

Learning inducing points and uncertainty on molecular data

Uncertainty control and scalability to large datasets are the two main i...

Please sign up or login with your details

Forgot password? Click here to reset