Towards new cross-validation-based estimators for Gaussian process regression: efficient adjoint computation of gradients

02/26/2020
by   Sébastien Petit, et al.
0

We consider the problem of estimating the parameters of the covariance function of a Gaussian process by cross-validation. We suggest using new cross-validation criteria derived from the literature of scoring rules. We also provide an efficient method for computing the gradient of a cross-validation criterion. To the best of our knowledge, our method is more efficient than what has been proposed in the literature so far. It makes it possible to lower the complexity of jointly evaluating leave-one-out criteria and their gradients.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/13/2021

Gaussian process interpolation: the choice of the family of models is more important than that of the selection criterion

This article revisits the fundamental problem of parameter selection for...
research
04/21/2021

On the Asymptotic Optimality of Cross-Validation based Hyper-parameter Estimators for Regularized Least Squares Regression Problems

The asymptotic optimality (a.o.) of various hyper-parameter estimators w...
research
09/05/2022

Using leave-one-out cross-validation (LOO) in a multilevel regression and poststratification (MRP) workflow: A cautionary tale

In recent decades, multilevel regression and poststratification (MRP) ha...
research
01/08/2021

Fast calculation of Gaussian Process multiple-fold cross-validation residuals and their covariances

We generalize fast Gaussian process leave-one-out formulae to multiple-f...
research
08/22/2019

Efficient Cross-Validation of Echo State Networks

Echo State Networks (ESNs) are known for their fast and precise one-shot...
research
06/19/2020

Efficient implementations of echo state network cross-validation

Background/introduction: Cross-validation is still uncommon in time seri...
research
12/30/2018

On Cross-validation for Sparse Reduced Rank Regression

In high-dimensional data analysis, regularization methods pursuing spars...

Please sign up or login with your details

Forgot password? Click here to reset