Eliminating Multicollinearity Issues in Neural Network Ensembles: Incremental, Negatively Correlated, Optimal Convex Blending

04/30/2021
by   Pola Lydia Lagari, et al.
0

Given a features, target dataset, we introduce an incremental algorithm that constructs an aggregate regressor, using an ensemble of neural networks. It is well known that ensemble methods suffer from the multicollinearity issue, which is the manifestation of redundancy arising mainly due to the common training-dataset. In the present incremental approach, at each stage we optimally blend the aggregate regressor with a newly trained neural network under a convexity constraint which, if necessary, induces negative correlations. Under this framework, collinearity issues do not arise at all, rendering so the method both accurate and robust.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2005

Neural network ensembles: Evaluation of aggregation algorithms

Ensembles of artificial neural networks show improved generalization cap...
research
08/11/2017

Deep Incremental Boosting

This paper introduces Deep Incremental Boosting, a new technique derived...
research
10/29/2020

Collaborative Method for Incremental Learning on Classification and Generation

Although well-trained deep neural networks have shown remarkable perform...
research
06/26/2020

Incremental inference of collective graphical models

We consider incremental inference problems from aggregate data for colle...
research
06/21/2021

Incremental Deep Neural Network Learning using Classification Confidence Thresholding

Most modern neural networks for classification fail to take into account...
research
01/17/2020

Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networks

Ensemble methods, traditionally built with independently trained de-corr...
research
05/08/2018

A Systematic Approach to Incremental Redundancy over Erasure Channels

As sensing and instrumentation play an increasingly important role in sy...

Please sign up or login with your details

Forgot password? Click here to reset