Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression

05/06/2021
by   Christian Fiedler, et al.
0

Gaussian Process Regression is a popular nonparametric regression method based on Bayesian principles that provides uncertainty estimates for its predictions. However, these estimates are of a Bayesian nature, whereas for some important applications, like learning-based control with safety guarantees, frequentist uncertainty bounds are required. Although such rigorous bounds are available for Gaussian Processes, they are too conservative to be useful in applications. This often leads practitioners to replacing these bounds by heuristics, thus breaking all theoretical guarantees. To address this problem, we introduce new uncertainty bounds that are rigorous, yet practically useful at the same time. In particular, the bounds can be explicitly evaluated and are much less conservative than state of the art results. Furthermore, we show that certain model misspecifications lead to only graceful degradation. We demonstrate these advantages and the usefulness of our results for learning-based control with numerical examples.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 7

05/07/2021

Learning-enhanced robust controller synthesis with rigorous statistical and control-theoretic guarantees

The combination of machine learning with control offers many opportuniti...
09/06/2021

Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications

Gaussian processes have become a promising tool for various safety-criti...
02/02/2021

Symplectic Gaussian Process Dynamics

Dynamics model learning is challenging and at the same time an active fi...
12/18/2019

Heteroscedastic Gaussian Process Regression on the Alkenone over Sea Surface Temperatures

To restore the historical sea surface temperatures (SSTs) better, it is ...
06/13/2019

Robust Regression for Safe Exploration in Control

We study the problem of safe learning and exploration in sequential cont...
03/25/2018

Finite-Data Performance Guarantees for the Output-Feedback Control of an Unknown System

As the systems we control become more complex, first-principle modeling ...
11/20/2020

The Value of Data in Learning-Based Control for Training Subset Selection

Despite the existence of formal guarantees for learning-based control ap...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.