Enhancing the Diversity of Predictions Combination by Negative Correlation Learning

by   Yun Bai, et al.
Beihang University

Predictions combination, as a combination model approach with adjustments in the output space, has flourished in recent years in research and competitions. Simple average is intuitive and robust, and is often used as a benchmark in predictions combination. However, some poorly performing sub-models can reduce the overall accuracy because the sub-models are not selected in advance. Even though some studies have selected the top sub-models for the combination after ranking them by mean square error, the covariance of them causes this approach to not yield much benefit. In this paper, we suggest to consider the diversity of sub-models in the predictions combination, which can be adopted to assist in selecting the most diverse model subset in the model pool using negative correlation learning. Three publicly available datasets are applied to evaluate the approach. The experimental results not only show the diversity of sub-models in the predictions combination incorporating negative correlation learning, but also produce predictions with accuracy far exceeding that of the simple average benchmark and some weighted average methods. Furthermore, by adjusting the penalty strength for negative correlation, the predictions combination also outperform the best sub-model. The value of this paper lies in its ease of use and effectiveness, allowing the predictions combination to embrace both diversity and accuracy.


page 16

page 17

page 21

page 22


High correlated variables creator machine: Prediction of the compressive strength of concrete

In this paper, we introduce a novel hybrid model for predicting the comp...

Model Agnostic Combination for Ensemble Learning

Ensemble of models is well known to improve single model performance. We...

Deep Negative Correlation Classification

Ensemble learning serves as a straightforward way to improve the perform...

Diversity in Ranking using Negative Reinforcement

In this paper, we consider the problem of diversity in ranking of the no...

Deconstructing Distributions: A Pointwise Framework of Learning

In machine learning, we traditionally evaluate the performance of a sing...

Please sign up or login with your details

Forgot password? Click here to reset