Error Bounds for Kernel-Based Linear System Identification with Unknown Hyperparameters

03/17/2023
by   Mingzhou Yin, et al.
0

The kernel-based method has been successfully applied in linear system identification using stable kernel designs. From a Gaussian process perspective, it automatically provides probabilistic error bounds for the identified models from the posterior covariance, which are useful in robust and stochastic control. However, the error bounds require knowledge of the true hyperparameters in the kernel design and are demonstrated to be inaccurate with estimated hyperparameters for lightly damped systems or in the presence of high noise. In this work, we provide reliable quantification of the estimation error when the hyperparameters are unknown. The bounds are obtained by first constructing a high-probability set for the true hyperparameters from the marginal likelihood function and then finding the worst-case posterior covariance within the set. The proposed bound is proven to contain the true model with a high probability and its validity is verified in numerical simulation.

READ FULL TEXT
research
09/06/2021

Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications

Gaussian processes have become a promising tool for various safety-criti...
research
06/20/2022

Noise Estimation in Gaussian Process Regression

We develop a computational procedure to estimate the covariance hyperpar...
research
05/25/2016

How priors of initial hyperparameters affect Gaussian process regression models

The hyperparameters in Gaussian process regression (GPR) model with a sp...
research
11/21/2014

Robust EM kernel-based methods for linear system identification

Recent developments in system identification have brought attention to r...
research
03/08/2022

Informative Planning for Worst-Case Error Minimisation in Sparse Gaussian Process Regression

We present a planning framework for minimising the deterministic worst-c...
research
05/18/2023

Uniform approximation of common Gaussian process kernels using equispaced Fourier grids

The high efficiency of a recently proposed method for computing with Gau...
research
09/12/2019

Closed-loop Model Selection for Kernel-based Models using Bayesian Optimization

Kernel-based nonparametric models have become very attractive for model-...

Please sign up or login with your details

Forgot password? Click here to reset