DeepAI AI Chat
Log In Sign Up

Fully Bayesian Analysis of the Relevance Vector Machine Classification for Imbalanced Data

by   Wenyang Wang, et al.
University of Nebraska–Lincoln
University of Missouri

Relevance Vector Machine (RVM) is a supervised learning algorithm extended from Support Vector Machine (SVM) based on the Bayesian sparsity model. Compared with the regression problem, RVM classification is difficult to be conducted because there is no closed-form solution for the weight parameter posterior. Original RVM classification algorithm used Newton's method in optimization to obtain the mode of weight parameter posterior then approximated it by a Gaussian distribution in Laplace's method. It would work but just applied the frequency methods in a Bayesian framework. This paper proposes a Generic Bayesian approach for the RVM classification. We conjecture that our algorithm achieves convergent estimates of the quantities of interest compared with the nonconvergent estimates of the original RVM classification algorithm. Furthermore, a Fully Bayesian approach with the hierarchical hyperprior structure for RVM classification is proposed, which improves the classification performance, especially in the imbalanced data problem. By the numeric studies, our proposed algorithms obtain high classification accuracy rates. The Fully Bayesian hierarchical hyperprior method outperforms the Generic one for the imbalanced data classification.


page 1

page 2

page 3

page 4


Distance-weighted Support Vector Machine

A novel linear classification method that possesses the merits of both t...

Face Detection Using Adaboosted SVM-Based Component Classifier

Recently, Adaboost has been widely used to improve the accuracy of any g...

Heteroscedastic Relevance Vector Machine

In this work we propose a heteroscedastic generalization to RVM, a fast ...

Virtual Vector Machine for Bayesian Online Classification

In a typical online learning scenario, a learner is required to process ...

Probabilistic Feature Selection and Classification Vector Machine

Sparse Bayesian learning is one of the state-of- the-art machine learnin...

A Semi-parametric Promotion Time Cure Model with Support Vector Machine

The promotion time cure rate model (PCM) is an extensively studied model...