Robust Prediction Interval estimation for Gaussian Processes by Cross-Validation method

06/09/2021
by   Naoufal Acharki, et al.
0

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. Unfortunately, these methods may give advantage to the solutions that fit observations in average, but they do not pay attention to the coverage and the width of Prediction Intervals. In this paper, we address the question of adjusting and calibrating Prediction Intervals for Gaussian Processes Regression. First we determine the model's parameters by a standard Cross-Validation or Maximum Likelihood Estimation method then we adjust the parameters to assess the optimal type II Coverage Probability to a nominal level. We apply a relaxation method to choose parameters that minimize the Wasserstein distance between the Gaussian distribution of the initial parameters (Cross-Validation or Maximum Likelihood Estimation) and the proposed Gaussian distribution among the set of parameters that achieved the desired Coverage Probability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2023

Comparing Scale Parameter Estimators for Gaussian Process Regression: Cross Validation and Maximum Likelihood

Gaussian process (GP) regression is a Bayesian nonparametric method for ...
research
03/21/2021

Detecting Label Noise via Leave-One-Out Cross-Validation

We present a simple algorithm for identifying and correcting real-valued...
research
05/12/2022

Probabilistic Estimation of Chirp Instantaneous Frequency Using Gaussian Processes

We present a probabilistic approach for estimating chirp signal and its ...
research
04/01/2021

Cross-validation: what does it estimate and how well does it do it?

Cross-validation is a widely-used technique to estimate prediction error...
research
06/30/2020

Conformal Prediction Intervals for Neural Networks Using Cross Validation

Neural networks are among the most powerful nonlinear models used to add...
research
12/21/2018

A new approach to learning in Dynamic Bayesian Networks (DBNs)

In this paper, we revisit the parameter learning problem, namely the est...
research
11/12/2018

An Easy Implementation of CV-TMLE

In the world of targeted learning, cross-validated targeted maximum like...

Please sign up or login with your details

Forgot password? Click here to reset