Weighting and Pruning based Ensemble Deep Random Vector Functional Link Network for Tabular Data Classification

01/15/2022
by   Qiushi Shi, et al.
0

In this paper, we first introduce batch normalization to the edRVFL network. This re-normalization method can help the network avoid divergence of the hidden features. Then we propose novel variants of Ensemble Deep Random Vector Functional Link (edRVFL). Weighted edRVFL (WedRVFL) uses weighting methods to give training samples different weights in different layers according to how the samples were classified confidently in the previous layer thereby increasing the ensemble's diversity and accuracy. Furthermore, a pruning-based edRVFL (PedRVFL) has also been proposed. We prune some inferior neurons based on their importance for classification before generating the next hidden layer. Through this method, we ensure that the randomly generated inferior features will not propagate to deeper layers. Subsequently, the combination of weighting and pruning, called Weighting and Pruning based Ensemble Deep Random Vector Functional Link Network (WPedRVFL), is proposed. We compare their performances with other state-of-the-art deep feedforward neural networks (FNNs) on 24 tabular UCI classification datasets. The experimental results illustrate the superior performance of our proposed methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/30/2019

Random Vector Functional Link Neural Network based Ensemble Deep Learning

In this paper, we propose a deep learning framework based on randomized ...
research
02/21/2023

Classy Ensemble: A Novel Ensemble Algorithm for Classification

We present Classy Ensemble, a novel ensemble-generation algorithm for cl...
research
07/30/2021

Random vector functional link neural network based ensemble deep learning for short-term load forecasting

Electricity load forecasting is crucial for the power systems' planning ...
research
02/13/2022

Random vector functional link network: recent developments, applications, and future directions

Neural networks have been successfully employed in various domain such a...
research
10/04/2019

Stacked Autoencoder Based Deep Random Vector Functional Link Neural Network for Classification

Extreme learning machine (ELM), which can be viewed as a variant of Rand...
research
04/10/2017

Parsimonious Random Vector Functional Link Network for Data Streams

The theory of random vector functional link network (RVFLN) has provided...
research
09/15/2021

On-the-Fly Ensemble Pruning in Evolving Data Streams

Ensemble pruning is the process of selecting a subset of componentclassi...

Please sign up or login with your details

Forgot password? Click here to reset