Support vector machine and its bias correction in high-dimension, low-sample-size settings

02/26/2017
by   Yugo Nakayama, et al.
0

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates tend to zero as the dimension goes to infinity under certain severe conditions. We show that the SVM is very biased in HDLSS settings and its performance is affected by the bias directly. In order to overcome such difficulties, we propose a bias-corrected SVM (BC-SVM). We show that the BC-SVM gives preferable performances in HDLSS settings. We also discuss the SVMs in multiclass HDLSS settings. Finally, we check the performance of the classifiers in actual data analyses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2013

Distance-weighted Support Vector Machine

A novel linear classification method that possesses the merits of both t...
research
08/23/2023

Leverage classifier: Another look at support vector machine

Support vector machine (SVM) is a popular classifier known for accuracy,...
research
02/23/2021

Estimating Average Treatment Effects with Support Vector Machines

Support vector machine (SVM) is one of the most popular classification a...
research
08/24/2015

Another Look at DWD: Thrifty Algorithm and Bayes Risk Consistency in RKHS

Distance weighted discrimination (DWD) is a margin-based classifier with...
research
03/16/2015

High-dimensional quadratic classifiers in non-sparse settings

We consider high-dimensional quadratic classifiers in non-sparse setting...
research
02/18/2012

Comparing SVM and Naive Bayes classifiers for text categorization with Wikitology as knowledge enrichment

The activity of labeling of documents according to their content is know...
research
12/19/2012

A complexity analysis of statistical learning algorithms

We apply information-based complexity analysis to support vector machine...

Please sign up or login with your details

Forgot password? Click here to reset