META-DES: A Dynamic Ensemble Selection Framework using Meta-Learning

09/30/2018
by   Rafael M. O. Cruz, et al.
0

Dynamic ensemble selection systems work by estimating the level of competence of each classifier from a pool of classifiers. Only the most competent ones are selected to classify a given test sample. This is achieved by defining a criterion to measure the level of competence of a base classifier, such as, its accuracy in local regions of the feature space around the query instance. However, using only one criterion about the behavior of a base classifier is not sufficient to accurately estimate its level of competence. In this paper, we present a novel dynamic ensemble selection framework using meta-learning. We propose five distinct sets of meta-features, each one corresponding to a different criterion to measure the level of competence of a classifier for the classification of input samples. The meta-features are extracted from the training data and used to train a meta-classifier to predict whether or not a base classifier is competent enough to classify an input instance. During the generalization phase, the meta-features are extracted from the query instance and passed down as input to the meta-classifier. The meta-classifier estimates, whether a base classifier is competent enough to be added to the ensemble. Experiments are conducted over several small sample size classification problems, i.e., problems with a high degree of uncertainty due to the lack of training data. Experimental results show the proposed meta-learning framework greatly improves classification accuracy when compared against current state-of-the-art dynamic ensemble selection techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2018

On Meta-Learning for Dynamic Ensemble Selection

In this paper, we propose a novel dynamic ensemble selection framework u...
research
09/02/2015

A DEEP analysis of the META-DES framework for dynamic selection of ensemble of classifiers

Dynamic ensemble selection (DES) techniques work by estimating the level...
research
11/01/2018

META-DES.Oracle: Meta-learning and feature selection for ensemble selection

The key issue in Dynamic Ensemble Selection (DES) is defining a suitable...
research
12/12/2022

Selective classification using a robust meta-learning approach

Selective classification involves identifying the subset of test samples...
research
04/09/2019

Evaluating Competence Measures for Dynamic Regressor Selection

Dynamic regressor selection (DRS) systems work by selecting the most com...
research
04/01/2020

Multi-label learning for dynamic model type recommendation

Dynamic selection techniques aim at selecting the local experts around e...
research
09/16/2021

Building an Ensemble of Classifiers via Randomized Models of Ensemble Members

Many dynamic ensemble selection (DES) methods are known in the literatur...

Please sign up or login with your details

Forgot password? Click here to reset