Proposing a Localized Relevance Vector Machine for Pattern Classification

by   Farhood Rismanchian, et al.

Relevance vector machine (RVM) can be seen as a probabilistic version of support vector machines which is able to produce sparse solutions by linearly weighting a small number of basis functions instead using all of them. Regardless of a few merits of RVM such as giving probabilistic predictions and relax of parameter tuning, it has poor prediction for test instances that are far away from the relevance vectors. As a solution, we propose a new combination of RVM and k-nearest neighbor (k-NN) rule which resolves this issue with regionally dealing with every test instance. In our settings, we obtain the relevance vectors for each test instance in the local area given by k-NN rule. In this way, relevance vectors are closer and more relevant to the test instance which results in a more accurate model. This can be seen as a piece-wise learner which locally classifies test instances. The model is hence called localized relevance vector machine (LRVM). The LRVM is examined on several datasets of the University of California, Irvine (UCI) repository. Results supported by statistical tests indicate that the performance of LRVM is competitive as compared with a few state-of-the-art classifiers.


k-Nearest Neighbor Optimization via Randomized Hyperstructure Convex Hull

In the k-nearest neighbor algorithm (k-NN), the determination of classes...

Variational Relevance Vector Machines

The Support Vector Machine (SVM) of Vapnik (1998) has become widely esta...

K-Nearest Neighbour and Support Vector Machine Hybrid Classification

In this paper, a novel K-Nearest Neighbour and Support Vector Machine hy...

An enhanced KNN-based twin support vector machine with stable learning rules

Among the extensions of twin support vector machine (TSVM), some scholar...

Support Vector Machines and Radon's Theorem

A support vector machine (SVM) is an algorithm which finds a hyperplane ...

Fully Bayesian Analysis of the Relevance Vector Machine Classification for Imbalanced Data

Relevance Vector Machine (RVM) is a supervised learning algorithm extend...

Relevance Vector Machine with Weakly Informative Hyperprior and Extended Predictive Information Criterion

In the variational relevance vector machine, the gamma distribution is r...