Improving Naive Bayes for Regression with Optimised Artificial Surrogate Data

07/16/2017
by   Michael Mayo, et al.
0

Can we evolve better training data for machine learning algorithms? To investigate this question we use population-based optimisation algorithms to generate artificial surrogate training data for naive Bayes for regression. We demonstrate that the generalisation performance of naive Bayes for regression models is enhanced by training them on the artificial data as opposed to the real data. These results are important for two reasons. Firstly, naive Bayes models are simple and interpretable but frequently underperform compared to more complex "black box" models, and therefore new methods of enhancing accuracy are called for. Secondly, the idea of using the real training data indirectly in the construction of the artificial training data, as opposed to directly for model training, is a novel twist on the usual machine learning paradigm.

READ FULL TEXT

page 1

page 6

page 11

page 12

research
10/19/2012

Locally Weighted Naive Bayes

Despite its simplicity, the naive Bayes classifier has surprised machine...
research
11/14/2021

Improving usual Naive Bayes classifier performances with Neural Naive Bayes based models

Naive Bayes is a popular probabilistic model appreciated for its simplic...
research
01/23/2013

Fast Learning from Sparse Data

We describe two techniques that significantly improve the running time o...
research
04/13/2023

Improved Naive Bayes with Mislabeled Data

Labeling mistakes are frequently encountered in real-world applications....
research
09/16/2015

Processing Analytical Workloads Incrementally

Analysis of large data collections using popular machine learning and st...
research
10/19/2012

Budgeted Learning of Naive-Bayes Classifiers

Frequently, acquiring training data has an associated cost. We consider ...
research
12/13/2021

A Survey of Toxic Comment Classification Methods

While in real life everyone behaves themselves at least to some extent, ...

Please sign up or login with your details

Forgot password? Click here to reset