A Comparative Analysis of Ensemble Classifiers: Case Studies in Genomics

09/19/2013
by   Sean Whalen, et al.
0

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case studies in genomics, namely the prediction of genetic interactions and protein functions, to demonstrate their efficacy on real-world datasets and draw useful conclusions about their behavior. These methods include simple aggregation, meta-learning, cluster-based meta-learning, and ensemble selection using heterogeneous classifiers trained on resampled data to improve the diversity of their predictions. We present a detailed analysis of these methods across 4 genomics datasets and find the best of these methods offer statistically significant improvements over the state of the art in their respective domains. In addition, we establish a novel connection between ensemble selection and meta-learning, demonstrating how both of these disparate methods establish a balance between ensemble diversity and performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2015

A DEEP analysis of the META-DES framework for dynamic selection of ensemble of classifiers

Dynamic ensemble selection (DES) techniques work by estimating the level...
research
03/27/2019

Diversity with Cooperation: Ensemble Methods for Few-Shot Classification

Few-shot classification consists of learning a predictive model that is ...
research
11/01/2018

META-DES.H: a dynamic ensemble selection technique using meta-learning and a dynamic weighting approach

In Dynamic Ensemble Selection (DES) techniques, only the most competent ...
research
12/10/2020

Ensemble Squared: A Meta AutoML System

The continuing rise in the number of problems amenable to machine learni...
research
07/08/2022

MACFE: A Meta-learning and Causality Based Feature Engineering Framework

Feature engineering has become one of the most important steps to improv...
research
11/01/2018

META-DES.Oracle: Meta-learning and feature selection for ensemble selection

The key issue in Dynamic Ensemble Selection (DES) is defining a suitable...
research
03/15/2017

Aggregation of Classifiers: A Justifiable Information Granularity Approach

In this study, we introduce a new approach to combine multi-classifiers ...

Please sign up or login with your details

Forgot password? Click here to reset