Cascading Randomized Weighted Majority: A New Online Ensemble Learning Algorithm

03/03/2014
by   Mohammadzaman Zamani, et al.
0

With the increasing volume of data in the world, the best approach for learning from this data is to exploit an online learning algorithm. Online ensemble methods are online algorithms which take advantage of an ensemble of classifiers to predict labels of data. Prediction with expert advice is a well-studied problem in the online ensemble learning literature. The Weighted Majority algorithm and the randomized weighted majority (RWM) are the most well-known solutions to this problem, aiming to converge to the best expert. Since among some expert, the best one does not necessarily have the minimum error in all regions of data space, defining specific regions and converging to the best expert in each of these regions will lead to a better result. In this paper, we aim to resolve this defect of RWM algorithms by proposing a novel online ensemble algorithm to the problem of prediction with expert advice. We propose a cascading version of RWM to achieve not only better experimental results but also a better error bound for sufficiently large datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2023

Optimal Prediction Using Expert Advice and Randomized Littlestone Dimension

A classical result in online learning characterizes the optimal mistake ...
research
07/30/2018

Online Learning with an Almost Perfect Expert

We study the online learning problem where a forecaster makes a sequence...
research
03/03/2023

Streaming Algorithms for Learning with Experts: Deterministic Versus Robust

In the online learning with experts problem, an algorithm must make a pr...
research
02/01/2021

Impossible Tuning Made Possible: A New Expert Algorithm and Its Applications

We resolve the long-standing "impossible tuning" issue for the classic e...
research
12/02/2013

Consistency of weighted majority votes

We revisit the classical decision-theoretic problem of weighted expert v...
research
07/08/2011

Polyceptron: A Polyhedral Learning Algorithm

In this paper we propose a new algorithm for learning polyhedral classif...
research
02/05/2020

Online Passive-Aggressive Total-Error-Rate Minimization

We provide a new online learning algorithm which utilizes online passive...

Please sign up or login with your details

Forgot password? Click here to reset