Noise Estimation in Gaussian Process Regression

06/20/2022
by   Siavash Ameli, et al.
0

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the correlated error, and the variance of the noise based on maximizing a marginal likelihood function. Our method involves suitably reducing the dimensionality of the hyperparameter space to simplify the estimation procedure to a univariate root-finding problem. Moreover, we derive bounds and asymptotes of the marginal likelihood function and its derivatives, which are useful to narrowing the initial range of the hyperparameter search. Using numerical examples, we demonstrate the computational advantages and robustness of the presented approach compared to traditional parameter optimization.

READ FULL TEXT

page 28

page 31

research
06/07/2023

Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models

Approximate inference in Gaussian process (GP) models with non-conjugate...
research
10/29/2011

Efficient Marginal Likelihood Computation for Gaussian Process Regression

In a Bayesian learning setting, the posterior distribution of a predicti...
research
10/17/2017

Deep Gaussian Covariance Network

The correlation length-scale next to the noise variance are the most use...
research
05/25/2016

How priors of initial hyperparameters affect Gaussian process regression models

The hyperparameters in Gaussian process regression (GPR) model with a sp...
research
03/17/2023

Error Bounds for Kernel-Based Linear System Identification with Unknown Hyperparameters

The kernel-based method has been successfully applied in linear system i...
research
11/25/2018

Robust Super-Level Set Estimation using Gaussian Processes

This paper focuses on the problem of determining as large a region as po...
research
07/01/2021

Reducing the Variance of Gaussian Process Hyperparameter Optimization with Preconditioning

Gaussian processes remain popular as a flexible and expressive model cla...

Please sign up or login with your details

Forgot password? Click here to reset