Noise-Resilient Ensemble Learning using Evidence Accumulation Clustering

10/18/2021
by   Gaëlle Candel, et al.
0

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm and communicate its results to its peers. Ensemble learning methods are naturally resilient to the absence of several peers thanks to the ensemble redundancy. However, the network can be corrupted, altering the prediction accuracy of a peer, which has a deleterious effect on the ensemble quality. In this paper, we propose a noise-resilient ensemble classification method, which helps to improve accuracy and correct random errors. The approach is inspired by Evidence Accumulation Clustering , adapted to classification ensembles. We compared it to the naive voter model over four multi-class datasets. Our model showed a greater resilience, allowing us to recover prediction under a very high noise level. In addition as the method is based on the evidence accumulation clustering, our method is highly flexible as it can combines classifiers with different label definitions.

READ FULL TEXT
research
08/29/2017

EC3: Combining Clustering and Classification for Ensemble Learning

Classification and clustering algorithms have been proved to be successf...
research
12/15/2021

Graph-based Ensemble Machine Learning for Student Performance Prediction

Student performance prediction is a critical research problem to underst...
research
11/14/2017

On Extending Neural Networks with Loss Ensembles for Text Classification

Ensemble techniques are powerful approaches that combine several weak le...
research
12/02/2021

Label noise detection under the Noise at Random model with ensemble filters

Label noise detection has been widely studied in Machine Learning becaus...
research
01/06/2021

The Shapley Value of Classifiers in Ensemble Games

How do we decide the fair value of individual classifiers in an ensemble...
research
03/27/2021

Deep Ensemble Collaborative Learning by using Knowledge-transfer Graph for Fine-grained Object Classification

Mutual learning, in which multiple networks learn by sharing their knowl...
research
06/09/2022

A Resilient Distributed Boosting Algorithm

Given a learning task where the data is distributed among several partie...

Please sign up or login with your details

Forgot password? Click here to reset