A Semi-Supervised Adaptive Discriminative Discretization Method Improving Discrimination Power of Regularized Naive Bayes

11/22/2021
by   Shihe Wang, et al.
0

Recently, many improved naive Bayes methods have been developed with enhanced discrimination capabilities. Among them, regularized naive Bayes (RNB) produces excellent performance by balancing the discrimination power and generalization capability. Data discretization is important in naive Bayes. By grouping similar values into one interval, the data distribution could be better estimated. However, existing methods including RNB often discretize the data into too few intervals, which may result in a significant information loss. To address this problem, we propose a semi-supervised adaptive discriminative discretization framework for naive Bayes, which could better estimate the data distribution by utilizing both labeled data and unlabeled data through pseudo-labeling techniques. The proposed method also significantly reduces the information loss during discretization by utilizing an adaptive discriminative discretization scheme, and hence greatly improves the discrimination power of classifiers. The proposed RNB+, i.e., regularized naive Bayes utilizing the proposed discretization framework, is systematically evaluated on a wide range of machine-learning datasets. It significantly and consistently outperforms state-of-the-art NB classifiers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2022

SPADE: Semi-supervised Anomaly Detection under Distribution Mismatch

Semi-supervised anomaly detection is a common problem, as often the data...
research
04/12/2022

Positive Feature Values Prioritized Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Hierarchical Feature Spaces

The Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes (HRE-T...
research
04/13/2023

Improved Naive Bayes with Mislabeled Data

Labeling mistakes are frequently encountered in real-world applications....
research
01/31/2018

Naive Bayes Entrapment Detection for Planetary Rovers

Entrapment detection is a prerequisite for planetary rovers to perform a...
research
12/12/2012

Bayesian Network Classifiers in a High Dimensional Framework

We present a growing dimension asymptotic formalism. The perspective in ...
research
02/05/2023

Revisiting Discriminative vs. Generative Classifiers: Theory and Implications

A large-scale deep model pre-trained on massive labeled or unlabeled dat...
research
02/13/2013

Geometric Implications of the Naive Bayes Assumption

A naive (or Idiot) Bayes network is a network with a single hypothesis n...

Please sign up or login with your details

Forgot password? Click here to reset