Bayesian Network Classifiers in a High Dimensional Framework

by   Tatjana Pavlenko, et al.

We present a growing dimension asymptotic formalism. The perspective in this paper is classification theory and we show that it can accommodate probabilistic networks classifiers, including naive Bayes model and its augmented version. When represented as a Bayesian network these classifiers have an important advantage: The corresponding discriminant function turns out to be a specialized case of a generalized additive model, which makes it possible to get closed form expressions for the asymptotic misclassification probabilities used here as a measure of classification accuracy. Moreover, in this paper we propose a new quantity for assessing the discriminative power of a set of features which is then used to elaborate the augmented naive Bayes classifier. The result is a weighted form of the augmented naive Bayes that distributes weights among the sets of features according to their discriminative power. We derive the asymptotic distribution of the sample based discriminative power and show that it is seriously overestimated in a high dimensional case. We then apply this result to find the optimal, in a sense of minimum misclassification probability, type of weighting.



page 1

page 2

page 3

page 4


Reasoning about Bayesian Network Classifiers

Bayesian network classifiers are used in many fields, and one common cla...

Comparing Bayesian Network Classifiers

In this paper, we empirically evaluate algorithms for learning four type...

Positive Feature Values Prioritized Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Hierarchical Feature Spaces

The Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes (HRE-T...

A Semi-Supervised Adaptive Discriminative Discretization Method Improving Discrimination Power of Regularized Naive Bayes

Recently, many improved naive Bayes methods have been developed with enh...

A New Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Coping with Gene Ontology-based Features

The Tree Augmented Naive Bayes classifier is a type of probabilistic gra...

Clustering and Bayesian network for image of faces classification

In a content based image classification system, target images are sorted...

A Feature Weighted Mixed Naive Bayes Model for Monitoring Anomalies in the Fan System of a Thermal Power Plant

With the increasing intelligence and integration, a great number of two-...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.