An Online Boosting Algorithm with Theoretical Justifications

06/27/2012
by   Shang-Tse Chen, et al.
0

We study the task of online boosting--combining online weak learners into an online strong learner. While batch boosting has a sound theoretical foundation, online boosting deserves more study from the theoretical perspective. In this paper, we carefully compare the differences between online and batch boosting, and propose a novel and reasonable assumption for the online weak learner. Based on the assumption, we design an online boosting algorithm with a strong theoretical guarantee by adapting from the offline SmoothBoost algorithm that matches the assumption closely. We further tackle the task of deciding the number of weak learners using established theoretical results for online convex programming and predicting with expert advice. Experiments on real-world data sets demonstrate that the proposed algorithm compares favorably with existing online boosting algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/27/2023

Online GentleAdaBoost – Technical Report

We study the online variant of GentleAdaboost, where we combine a weak l...
research
10/24/2008

Online Coordinate Boosting

We present a new online boosting algorithm for adapting the weights of a...
research
05/19/2022

A Boosting Algorithm for Positive-Unlabeled Learning

Positive-unlabeled (PU) learning deals with binary classification proble...
research
01/23/2023

The Impossibility of Parallelizing Boosting

The aim of boosting is to convert a sequence of weak learners into a str...
research
06/20/2019

Boosting for Dynamical Systems

We propose a framework of boosting for learning and control in environme...
research
10/24/2019

Online Boosting for Multilabel Ranking with Top-k Feedback

We present online boosting algorithms for multilabel ranking with top-k ...
research
06/25/2023

Language models are weak learners

A central notion in practical and theoretical machine learning is that o...

Please sign up or login with your details

Forgot password? Click here to reset