Total Stability of SVMs and Localized SVMs

01/29/2021
by   Hannes Köhler, et al.
0

Regularized kernel-based methods such as support vector machines (SVMs) typically depend on the underlying probability measure P (respectively an empirical measure D_n in applications) as well as on the regularization parameter λ and the kernel k. Whereas classical statistical robustness only considers the effect of small perturbations in P, the present paper investigates the influence of simultaneous slight variations in the whole triple (P,λ,k), respectively (D_n,λ_n,k), on the resulting predictor. Existing results from the literature are considerably generalized and improved. In order to also make them applicable to big data, where regular SVMs suffer from their super-linear computational requirements, we show how our results can be transferred to the context of localized learning. Here, the effect of slight variations in the applied regionalization, which might for example stem from changes in P respectively D_n, is considered as well.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2023

Lp- and Risk Consistency of Localized SVMs

Kernel-based regularized risk minimizers, also called support vector mac...
research
03/19/2017

Universal Consistency and Robustness of Localized Support Vector Machines

The massive amount of available data potentially used to discover patter...
research
09/22/2017

Total stability of kernel methods

Regularized empirical risk minimization using kernels and their correspo...
research
03/01/2019

Quantitative Robustness of Localized Support Vector Machines

The huge amount of available data nowadays is a challenge for kernel-bas...
research
03/27/2023

On the Connection between L_p and Risk Consistency and its Implications on Regularized Kernel Methods

As a predictor's quality is often assessed by means of its risk, it is n...
research
05/04/2019

Improved Classification Rates for Localized SVMs

One of the main characteristics of localized support vector machines tha...

Please sign up or login with your details

Forgot password? Click here to reset