Self-paced ensemble learning for speech and audio classification

03/22/2021
by   Nicolae-Catalin Ristea, et al.
0

Combining multiple machine learning models into an ensemble is known to provide superior performance levels compared to the individual components forming the ensemble. This is because models can complement each other in taking better decisions. Instead of just combining the models, we propose a self-paced ensemble learning scheme in which models learn from each other over several iterations. During the self-paced learning process based on pseudo-labeling, in addition to improving the individual models, our ensemble also gains knowledge about the target domain. To demonstrate the generality of our self-paced ensemble learning (SPEL) scheme, we conduct experiments on three audio tasks. Our empirical results indicate that SPEL significantly outperforms the baseline ensemble models. We also show that applying self-paced learning on individual models is less effective, illustrating the idea that models in the ensemble actually learn from each other.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2022

The Ability of Self-Supervised Speech Models for Audio Representations

Self-supervised learning (SSL) speech models have achieved unprecedented...
research
02/21/2023

Classy Ensemble: A Novel Ensemble Algorithm for Classification

We present Classy Ensemble, a novel ensemble-generation algorithm for cl...
research
06/07/2022

Click Prediction Boosting via Ensemble Learning Pipelines

Online travel agencies (OTA's) advertise their website offers on meta-se...
research
04/09/2021

Self-Weighted Ensemble Method to Adjust the Influence of Individual Models based on Reliability

Image classification technology and performance based on Deep Learning h...
research
05/26/2019

Ensemble Decision Systems for General Video Game Playing

Ensemble Decision Systems offer a unique form of decision making that al...
research
07/03/2018

Coopetitive Soft Gating Ensemble

In this article, we proposed the Coopetititve Soft Gating Ensemble or CS...
research
05/02/2020

Single Model Ensemble using Pseudo-Tags and Distinct Vectors

Model ensemble techniques often increase task performance in neural netw...

Please sign up or login with your details

Forgot password? Click here to reset