Local Probabilistic Model for Bayesian Classification: a Generalized Local Classification Model

12/13/2018
by   Chengsheng Mao, et al.
0

In Bayesian classification, it is important to establish a probabilistic model for each class for likelihood estimation. Most of the previous methods modeled the probability distribution in the whole sample space. However, real-world problems are usually too complex to model in the whole sample space; some fundamental assumptions are required to simplify the global model, for example, the class conditional independence assumption for naive Bayesian classification. In this paper, with the insight that the distribution in a local sample space should be simpler than that in the whole sample space, a local probabilistic model established for a local region is expected much simpler and can relax the fundamental assumptions that may not be true in the whole sample space. Based on these advantages we propose establishing local probabilistic models for Bayesian classification. In addition, a Bayesian classifier adopting a local probabilistic model can even be viewed as a generalized local classification model; by tuning the size of the local region and the corresponding local model assumption, a fitting model can be established for a particular classification problem. The experimental results on several real-world datasets demonstrate the effectiveness of local probabilistic models for Bayesian classification.

READ FULL TEXT
research
01/30/2013

Context-Specific Approximation in Probabilistic Inference

There is evidence that the numbers in probabilistic inference don't real...
research
05/05/2013

Efficient Estimation of the number of neighbours in Probabilistic K Nearest Neighbour Classification

Probabilistic k-nearest neighbour (PKNN) classification has been introdu...
research
08/07/2018

Instance-Dependent PU Learning by Bayesian Optimal Relabeling

When learning from positive and unlabelled data, it is a strong assumpti...
research
01/08/2018

The Expected Parameter Change (EPC) for Local Dependence Assessment in Binary Data Latent Class Models

Binary data latent class models crucially assume local independence, vio...
research
06/01/2011

Committee-Based Sample Selection for Probabilistic Classifiers

In many real-world learning tasks, it is expensive to acquire a sufficie...
research
02/06/2013

Models and Selection Criteria for Regression and Classification

When performing regression or classification, we are interested in the c...
research
10/05/2016

Generalized Inverse Classification

Inverse classification is the process of perturbing an instance in a mea...

Please sign up or login with your details

Forgot password? Click here to reset