Model selection for Gaussian processes utilizing sensitivity of posterior predictive distribution

12/21/2017
by   Topi Paananen, et al.
0

We propose two novel methods for simplifying Gaussian process (GP) models by examining the predictions of a full model in the vicinity of the training points and thereby ordering the covariates based on their predictive relevance. Our results on synthetic and real world data sets demonstrate improved variable selection compared to automatic relevance determination (ARD) in terms of consistency and predictive performance. We expect our proposed methods to be useful in interpreting and understanding complex Gaussian process models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2023

Generalized Variable Selection Algorithms for Gaussian Process Models by LASSO-like Penalty

With the rapid development of modern technology, massive amounts of data...
research
04/26/2023

Mixtures of Gaussian process experts based on kernel stick-breaking processes

Mixtures of Gaussian process experts is a class of models that can simul...
research
06/30/2015

Gaussian Process for Noisy Inputs with Ordering Constraints

We study the Gaussian Process regression model in the context of trainin...
research
01/06/2020

An Automatic Relevance Determination Prior Bayesian Neural Network for Controlled Variable Selection

We present an Automatic Relevance Determination prior Bayesian Neural Ne...
research
09/16/2017

Forecasting of commercial sales with large scale Gaussian Processes

This paper argues that there has not been enough discussion in the field...
research
08/31/2022

Automatic Dynamic Relevance Determination for Gaussian process regression with high-dimensional functional inputs

In the context of Gaussian process regression with functional inputs, it...
research
11/04/2022

Improving the Predictive Performances of k Nearest Neighbors Learning by Efficient Variable Selection

This paper computationally demonstrates a sharp improvement in predictiv...

Please sign up or login with your details

Forgot password? Click here to reset