Prediction performance after learning in Gaussian process regression

06/13/2016
by   Johan Wågberg, et al.
0

This paper considers the quantification of the prediction performance in Gaussian process regression. The standard approach is to base the prediction error bars on the theoretical predictive variance, which is a lower bound on the mean square-error (MSE). This approach, however, does not take into account that the statistical model is learned from the data. We show that this omission leads to a systematic underestimation of the prediction errors. Starting from a generalization of the Cramér-Rao bound, we derive a more accurate MSE bound which provides a measure of uncertainty for prediction of Gaussian processes. The improved bound is easily computed and we illustrate it using synthetic and real data examples. of uncertainty for prediction of Gaussian processes and illustrate it using synthetic and real data examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/16/2018

Mean Square Prediction Error of Misspecified Gaussian Process Models

Nonparametric modeling approaches show very promising results in the are...
research
04/07/2020

Direct loss minimization for sparse Gaussian processes

The Gaussian process (GP) is an attractive Bayesian model for machine le...
research
05/29/2023

Gaussian Process Probes (GPP) for Uncertainty-Aware Probing

Understanding which concepts models can and cannot represent has been fu...
research
02/04/2020

Gaussian Processes with Input Location Error and Applications to the Composite Parts Assembly Process

In this paper, we investigate Gaussian process regression with input loc...
research
11/06/2020

Bayesian Regression and Classification Using Gaussian Process Priors Indexed by Probability Density Functions

In this paper, we introduce the notion of Gaussian processes indexed by ...
research
10/18/2020

JSRT: James-Stein Regression Tree

Regression tree (RT) has been widely used in machine learning and data m...
research
08/06/2019

Debiasing Linear Prediction

Standard methods in supervised learning separate training and prediction...

Please sign up or login with your details

Forgot password? Click here to reset