Promoting High Diversity Ensemble Learning with EnsembleBench

by   Yanzhao Wu, et al.

Ensemble learning is gaining renewed interests in recent years. This paper presents EnsembleBench, a holistic framework for evaluating and recommending high diversity and high accuracy ensembles. The design of EnsembleBench offers three novel features: (1) EnsembleBench introduces a set of quantitative metrics for assessing the quality of ensembles and for comparing alternative ensembles constructed for the same learning tasks. (2) EnsembleBench implements a suite of baseline diversity metrics and optimized diversity metrics for identifying and selecting ensembles with high diversity and high quality, making it an effective framework for benchmarking, evaluating and recommending high diversity model ensembles. (3) Four representative ensemble consensus methods are provided in the first release of EnsembleBench, enabling empirical study on the impact of consensus methods on ensemble accuracy. A comprehensive experimental evaluation on popular benchmark datasets demonstrates the utility and effectiveness of EnsembleBench for promoting high diversity ensembles and boosting the overall performance of selected ensembles.



page 3


Deep Neural Network Ensembles against Deception: Ensemble Diversity, Accuracy and Robustness

Ensemble learning is a methodology that integrates multiple DNN learners...

Neural Network Ensembles: Theory, Training, and the Importance of Explicit Diversity

Ensemble learning is a process by which multiple base learners are strat...

Ensembles of Models and Metrics for Robust Ranking of Homologous Proteins

An ensemble of models (EM), where each model is constructed on a diverse...

Representative volume elements for matrix-inclusion composites – a computational study on periodizing the ensemble

We investigate volume-element sampling strategies for the stochastic hom...

Developing parsimonious ensembles using predictor diversity within a reinforcement learning framework

Heterogeneous ensembles that can aggregate an unrestricted number and va...

Auxiliary Class Based Multiple Choice Learning

The merit of ensemble learning lies in having different outputs from man...

An Empirical Study of Modular Bias Mitigators and Ensembles

There are several bias mitigators that can reduce algorithmic bias in ma...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.