On the Connection between L_p and Risk Consistency and its Implications on Regularized Kernel Methods

03/27/2023
by   Hannes Köhler, et al.
0

As a predictor's quality is often assessed by means of its risk, it is natural to regard risk consistency as a desirable property of learning methods, and many such methods have indeed been shown to be risk consistent. The first aim of this paper is to establish the close connection between risk consistency and L_p-consistency for a considerably wider class of loss functions than has been done before. The attempt to transfer this connection to shifted loss functions surprisingly reveals that this shift does not reduce the assumptions needed on the underlying probability measure to the same extent as it does for many other results. The results are applied to regularized kernel methods such as support vector machines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2023

Lp- and Risk Consistency of Localized SVMs

Kernel-based regularized risk minimizers, also called support vector mac...
research
10/12/2015

On the Robustness of Regularized Pairwise Learning Methods Based on Kernels

Regularized empirical risk minimization including support vector machine...
research
06/17/2020

Regularized ERM on random subspaces

We study a natural extension of classical empirical risk minimization, w...
research
08/30/2019

Consistency and Finite Sample Behavior of Binary Class Probability Estimation

In this work we investigate to which extent one can recover class probab...
research
04/15/2016

A short note on extension theorems and their connection to universal consistency in machine learning

Statistical machine learning plays an important role in modern statistic...
research
01/29/2021

Total Stability of SVMs and Localized SVMs

Regularized kernel-based methods such as support vector machines (SVMs) ...
research
05/25/2018

Function Estimation via Reconstruction

This paper introduces an interpolation-based method, called the reconstr...

Please sign up or login with your details

Forgot password? Click here to reset