DeepAI AI Chat
Log In Sign Up

Model Selection for Gaussian Process Regression by Approximation Set Coding

10/04/2016
by   Benjamin Fischer, et al.
0

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The functions to be compared do not just differ in their parametrization but in their fundamental structure. It is often not clear which function structure to choose, for instance to decide between a squared exponential and a rational quadratic kernel. Based on the principle of approximation set coding, we develop a framework for model selection to rank kernels for Gaussian process regression. In our experiments approximation set coding shows promise to become a model selection criterion competitive with maximum evidence (also called marginal likelihood) and leave-one-out cross-validation.

READ FULL TEXT

page 7

page 9

11/01/2022

Bayesian Structural Identification using Gaussian Process Discrepancy Models

Bayesian model updating based on Gaussian Process (GP) models has receiv...
02/18/2014

Student-t Processes as Alternatives to Gaussian Processes

We investigate the Student-t process as an alternative to the Gaussian p...
06/26/2012

Predictive Approaches For Gaussian Process Classifier Model Selection

In this paper we consider the problem of Gaussian process classifier (GP...
02/22/2011

Predictive Active Set Selection Methods for Gaussian Processes

We propose an active set selection framework for Gaussian process classi...
11/05/2010

Model Selection by Loss Rank for Classification and Unsupervised Learning

Hutter (2007) recently introduced the loss rank principle (LoRP) as a ge...
11/05/2021

Exploiting a Zoo of Checkpoints for Unseen Tasks

There are so many models in the literature that it is difficult for prac...