Accelerating Kernel Classifiers Through Borders Mapping

08/20/2017
by   Peter Mills, et al.
0

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data, however, they can be slow, especially for large problems. Piecewise linear classifiers are similarly versatile, yet have the additional advantages of simplicity, ease of interpretation and, if the number of component linear classifiers is not too large, speed. Here we show how a simple, piecewise linear classifier can be trained from a kernel-based classifier in order to improve the classification speed. The method works by finding the root of the difference in conditional probabilities between pairs of opposite classes to build up a representation of the decision boundary. When tested on 17 different datasets, it succeeded in improving the classification speed of a SVM for 9 of them by factors as high as 88 times or more. The method is best suited to problems with continuum features data and smooth probability functions. Because the component linear classifiers are built up individually from an existing classifier, rather than through a simultaneous optimization procedure, the classifier is also fast to train.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/23/2023

Leverage classifier: Another look at support vector machine

Support vector machine (SVM) is a popular classifier known for accuracy,...
research
10/05/2011

Linearized Additive Classifiers

We revisit the additive model learning literature and adapt a penalized ...
research
06/14/2019

Support vector machines on the D-Wave quantum annealer

Kernel-based support vector machines (SVMs) are supervised machine learn...
research
11/15/2019

Face shape classification using Inception v3

In this paper, we present experimental results obtained from retraining ...
research
06/04/2015

An Average Classification Algorithm

Many classification algorithms produce a classifier that is a weighted a...
research
02/21/2018

Determining the best classifier for predicting the value of a boolean field on a blood donor database

Motivation: Thanks to digitization, we often have access to large databa...
research
08/04/2014

Multithreshold Entropy Linear Classifier

Linear classifiers separate the data with a hyperplane. In this paper we...

Please sign up or login with your details

Forgot password? Click here to reset