A Combinatorial Characterization of Online Learning Games with Bounded Losses

07/07/2023
by   Vinod Raman, et al.
0

We study the online learnability of hypothesis classes with respect to arbitrary, but bounded, loss functions. We give a new scale-sensitive combinatorial dimension, named the sequential Minimax dimension, and show that it gives a tight quantitative characterization of online learnability. As applications, we give the first quantitative characterization of online learnability for two natural learning settings: vector-valued regression and multilabel classification.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 9

page 12

page 17

page 18

research
07/07/2023

Optimal Learners for Realizable Regression: PAC Learning and Online Learning

In this work, we aim to characterize the statistical complexity of reali...
research
02/08/2020

Towards a combinatorial characterization of bounded memory learning

Combinatorial dimensions play an important role in the theory of machine...
research
01/26/2015

Online Nonparametric Regression with General Loss Functions

This paper establishes minimax rates for online regression with arbitrar...
research
11/17/2021

Fast Rates for Nonparametric Online Learning: From Realizability to Learning in Games

We study fast rates of convergence in the setting of nonparametric onlin...
research
02/02/2021

Majorizing Measures, Sequential Complexities, and Online Learning

We introduce the technique of generic chaining and majorizing measures f...
research
02/02/2021

Online Learning with Simple Predictors and a Combinatorial Characterization of Minimax in 0/1 Games

Which classes can be learned properly in the online model? – that is, by...
research
03/30/2023

A Characterization of Online Multiclass Learnability

We consider the problem of online multiclass learning when the number of...

Please sign up or login with your details

Forgot password? Click here to reset