Deterministic error bounds for kernel-based learning techniques under bounded noise

08/10/2020
by   Emilio T. Maddalena, et al.
0

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and ε-support vector regression. By assuming the ground-truth function belongs to the reproducing kernel Hilbert space of the chosen kernel, and the measurement noise affecting the dataset is bounded, we adopt an approximation theory viewpoint to establish deterministic error bounds for the two models. Finally, we discuss their connection with Gaussian processes and two numerical examples are provided. In establishing our inequalities, we hope to help bring the fields of non-parametric kernel learning and robust control closer to each other.

READ FULL TEXT
research
04/19/2021

Robust Uncertainty Bounds in Reproducing Kernel Hilbert Spaces: A Convex Optimization Approach

Let a labeled dataset be given with scattered samples and consider the h...
research
03/16/2023

Error analysis of regularized trigonometric linear regression with unbounded sampling: a statistical learning viewpoint

The effectiveness of non-parametric, kernel-based methods for function e...
research
09/14/2023

Convergence analysis of online algorithms for vector-valued kernel regression

We consider the problem of approximating the regression function from no...
research
01/25/2015

Randomized sketches for kernels: Fast and optimal non-parametric regression

Kernel ridge regression (KRR) is a standard method for performing non-pa...
research
06/02/2020

Non-asymptotic Analysis in Kernel Ridge Regression

We develop a general non-asymptotic analysis of learning rates in kernel...
research
04/16/2012

Learning Sets with Separating Kernels

We consider the problem of learning a set from random samples. We show h...
research
09/22/2020

Risk upper bounds for RKHS ridge group sparse estimator in the regression model with non-Gaussian and non-bounded error

We consider the problem of estimating a meta-model of an unknown regress...

Please sign up or login with your details

Forgot password? Click here to reset