DeepAI AI Chat
Log In Sign Up

Model Selection for Gaussian Process Regression by Approximation Set Coding

by   Benjamin Fischer, et al.

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The functions to be compared do not just differ in their parametrization but in their fundamental structure. It is often not clear which function structure to choose, for instance to decide between a squared exponential and a rational quadratic kernel. Based on the principle of approximation set coding, we develop a framework for model selection to rank kernels for Gaussian process regression. In our experiments approximation set coding shows promise to become a model selection criterion competitive with maximum evidence (also called marginal likelihood) and leave-one-out cross-validation.


page 7

page 9


Bayesian Structural Identification using Gaussian Process Discrepancy Models

Bayesian model updating based on Gaussian Process (GP) models has receiv...

Student-t Processes as Alternatives to Gaussian Processes

We investigate the Student-t process as an alternative to the Gaussian p...

Predictive Approaches For Gaussian Process Classifier Model Selection

In this paper we consider the problem of Gaussian process classifier (GP...

Predictive Active Set Selection Methods for Gaussian Processes

We propose an active set selection framework for Gaussian process classi...

Model Selection by Loss Rank for Classification and Unsupervised Learning

Hutter (2007) recently introduced the loss rank principle (LoRP) as a ge...

Exploiting a Zoo of Checkpoints for Unseen Tasks

There are so many models in the literature that it is difficult for prac...