Envelope imbalanced ensemble model with deep sample learning and local-global structure consistency

06/25/2022
by   Fan Li, et al.
0

The class imbalance problem is important and challenging. Ensemble approaches are widely used to tackle this problem because of their effectiveness. However, existing ensemble methods are always applied into original samples, while not considering the structure information among original samples. The limitation will prevent the imbalanced learning from being better. Besides, research shows that the structure information among samples includes local and global structure information. Based on the analysis above, an imbalanced ensemble algorithm with the deep sample pre-envelope network (DSEN) and local-global structure consistency mechanism (LGSCM) is proposed here to solve the problem.This algorithm can guarantee high-quality deep envelope samples for considering the local manifold and global structures information, which is helpful for imbalance learning. First, the deep sample envelope pre-network (DSEN) is designed to mine structure information among samples.Then, the local manifold structure metric (LMSM) and global structure distribution metric (GSDM) are designed to construct LGSCM to enhance distribution consistency of interlayer samples. Next, the DSEN and LGSCM are put together to form the final deep sample envelope network (DSEN-LG). After that, base classifiers are applied on the layers of deep samples respectively.Finally, the predictive results from base classifiers are fused through bagging ensemble learning mechanism. To demonstrate the effectiveness of the proposed method, forty-four public datasets and more than ten representative relevant algorithms are chosen for verification. The experimental results show that the algorithm is significantly better than other imbalanced ensemble algorithms.

READ FULL TEXT
research
10/25/2022

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Stack autoencoder (SAE), as a representative deep network, has unique an...
research
09/12/2019

On an enhancement of RNA probing data using Information Theory

Identifying the secondary structure of an RNA is crucial for understandi...
research
11/29/2017

NPC: Neighbors Progressive Competition Algorithm for Classification of Imbalanced Data Sets

Learning from many real-world datasets is limited by a problem called th...
research
11/02/2021

Envelope Imbalance Learning Algorithm based on Multilayer Fuzzy C-means Clustering and Minimum Interlayer discrepancy

Imbalanced learning is important and challenging since the problem of th...
research
08/09/2019

Adaptive Ensemble of Classifiers with Regularization for Imbalanced Data Classification

Dynamic ensembling of classifiers is an effective approach in processing...
research
06/16/2022

Local overlap reduction procedure for dynamic ensemble selection

Class imbalance is a characteristic known for making learning more chall...
research
04/20/2016

Scene Parsing with Integration of Parametric and Non-parametric Models

We adopt Convolutional Neural Networks (CNNs) to be our parametric model...

Please sign up or login with your details

Forgot password? Click here to reset