Robust Gaussian Process Regression with a Bias Model

01/14/2020
by   Chiwoo Park, et al.
21

This paper presents a new approach to a robust Gaussian process (GP) regression. Most existing approaches replace an outlier-prone Gaussian likelihood with a non-Gaussian likelihood induced from a heavy tail distribution, such as the Laplace distribution and Student-t distribution. However, the use of a non-Gaussian likelihood would incur the need for a computationally expensive Bayesian approximate computation in the posterior inferences. The proposed approach models an outlier as a noisy and biased observation of an unknown regression function, and accordingly, the likelihood contains bias terms to explain the degree of deviations from the regression function. We entail how the biases can be estimated accurately with other hyperparameters by a regularized maximum likelihood estimation. Conditioned on the bias estimates, the robust GP regression can be reduced to a standard GP regression problem with analytical forms of the predictive mean and variance estimates. Therefore, the proposed approach is simple and very computationally attractive. It also gives a very robust and accurate GP estimate for many tested scenarios. For the numerical evaluation, we perform a comprehensive simulation study to evaluate the proposed approach with the comparison to the existing robust GP approaches under various simulated scenarios of different outlier proportions and different noise levels. The approach is applied to data from two measurement systems, where the predictors are based on robust environmental parameter measurements and the response variables utilize more complex chemical sensing methods that contain a certain percentage of outliers. The utility of the measurement systems and value of the environmental data are improved through the computationally efficient GP regression and bias model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2020

Robust Gaussian Process Regression Based on Iterative Trimming

The model prediction of the Gaussian process (GP) regression can be sign...
research
04/13/2021

Gaussian Process Model for Estimating Piecewise Continuous Regression Functions

This paper presents a Gaussian process (GP) model for estimating piecewi...
research
10/11/2022

Computationally-efficient initialisation of GPs: The generalised variogram method

We present a computationally-efficient strategy to find the hyperparamet...
research
07/20/2020

Iterative Method for Tuning Complex Simulation Code

Tuning a complex simulation code refers to the process of improving the ...
research
08/25/2020

Variable selection for Gaussian process regression through a sparse projection

This paper presents a new variable selection approach integrated with Ga...
research
03/08/2022

Inferring Parsimonious Coupling Statistics in Nonlinear Dynamics with Variational Gaussian Processes

Nonparametetric methods of uncovering coupling provides a flexible frame...

Please sign up or login with your details

Forgot password? Click here to reset