Issues in Stacked Generalization

05/27/2011
by   K. M. Ting, et al.
0

Stacked generalization is a general method of using a high-level model to combine lower-level models to achieve greater predictive accuracy. In this paper we address two crucial issues which have been considered to be a `black art' in classification tasks ever since the introduction of stacked generalization in 1992 by Wolpert: the type of generalizer that is suitable to derive the higher-level model, and the kind of attributes that should be used as its input. We find that best results are obtained when the higher-level model combines the confidence (and not just the predictions) of the lower-level ones. We demonstrate the effectiveness of stacked generalization for combining three different types of learning algorithms for classification tasks. We also compare the performance of stacked generalization with majority vote and published results of arcing and bagging.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2022

Combining Varied Learners for Binary Classification using Stacked Generalization

The Machine Learning has various learning algorithms that are better in ...
research
11/29/2018

Deep Haar Scattering Networks in Pattern Recognition: A promising approach

The aim of this paper is to discuss the use of Haar scattering networks,...
research
05/25/2023

Theoretical Guarantees of Learning Ensembling Strategies with Applications to Time Series Forecasting

Ensembling is among the most popular tools in machine learning (ML) due ...
research
09/22/2020

Stacked Generalization for Human Activity Recognition

This short paper aims to discuss the effectiveness and performance of cl...
research
10/16/2016

Dynamic Stacked Generalization for Node Classification on Networks

We propose a novel stacked generalization (stacking) method as a dynamic...
research
09/29/2021

Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration

An increasingly common use case for machine learning models is augmentin...
research
11/30/2016

Reliable Evaluation of Neural Network for Multiclass Classification of Real-world Data

This paper presents a systematic evaluation of Neural Network (NN) for c...

Please sign up or login with your details

Forgot password? Click here to reset