Posterior Variance Analysis of Gaussian Processes with Application to Average Learning Curves

06/04/2019
by   Armin Lederer, et al.
0

The posterior variance of Gaussian processes is a valuable measure of the learning error which is exploited in various applications such as safe reinforcement learning and control design. However, suitable analysis of the posterior variance which captures its behavior for finite and infinite number of training data is missing. This paper derives a novel bound for the posterior variance function which requires only local information because it depends only on the number of training samples in the proximity of a considered test point. Furthermore, we prove sufficient conditions which ensure the convergence of the posterior variance to zero. Finally, we demonstrate that the extension of our bound to an average learning bound outperforms existing approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/13/2021

Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Control

In application areas where data generation is expensive, Gaussian proces...
01/18/2018

Upgrading from Gaussian Processes to Student's-T Processes

Gaussian process priors are commonly used in aerospace design for perfor...
06/04/2019

Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control

Data-driven models are subject to model errors due to limited and noisy ...
10/19/2020

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Recent advances in Deep Gaussian Processes (DGPs) show the potential to ...
10/28/2021

Conditioning Sparse Variational Gaussian Processes for Online Decision-making

With a principled representation of uncertainty and closed form posterio...
03/15/2018

Gaussian Processes Over Graphs

We propose Gaussian processes for signals over graphs (GPG) using the ap...
02/27/2012

Replica theory for learning curves for Gaussian processes on random graphs

Statistical physics approaches can be used to derive accurate prediction...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.