Learning rates for partially linear support vector machine in high dimensions

06/05/2020
by   Yifan Xia, et al.
0

This paper analyzes a new regularized learning scheme for high dimensional partially linear support vector machine. The proposed approach consists of an empirical risk and the Lasso-type penalty for linear part, as well as the standard functional norm for nonlinear part. Here the linear kernel is used for model interpretation and feature selection, while the nonlinear kernel is adopted to enhance algorithmic flexibility. In this paper, we develop a new technical analysis on the weighted empirical process, and establish the sharp learning rates for the semi-parametric estimator under the regularized conditions. Specially, our derived learning rates for semi-parametric SVM depend on not only the sample size and the functional complexity, but also the sparsity and the margin parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2010

Asymptotic Normality of Support Vector Machine Variants and Other Regularized Kernel Methods

In nonparametric classification and regression problems, regularized ker...
research
06/09/2023

Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

In this paper we present a Twin Parametric-Margin Support Vector Machine...
research
03/01/2022

Nonlinear Kernel Support Vector Machine with 0-1 Soft Margin Loss

Recent advance on linear support vector machine with the 0-1 soft margin...
research
07/24/2023

Nonparametric Linear Feature Learning in Regression Through Regularisation

Representation learning plays a crucial role in automated feature select...
research
10/18/2022

Explainable bilevel optimization: an application to the Helsinki deblur challenge

In this paper we present a bilevel optimization scheme for the solution ...
research
10/18/2021

Kernel-based estimation for partially functional linear model: Minimax rates and randomized sketches

This paper considers the partially functional linear model (PFLM) where ...
research
08/22/2019

Quadratic Surface Support Vector Machine with L1 Norm Regularization

We propose ℓ_1 norm regularized quadratic surface support vector machine...

Please sign up or login with your details

Forgot password? Click here to reset