PAC-Bayes Iterated Logarithm Bounds for Martingale Mixtures

06/22/2015
by   Akshay Balsubramani, et al.
0

We give tight concentration bounds for mixtures of martingales that are simultaneously uniform over (a) mixture distributions, in a PAC-Bayes sense; and (b) all finite times. These bounds are proved in terms of the martingale variance, extending classical Bernstein inequalities, and sharpening and simplifying prior work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2020

A Limitation of the PAC-Bayes Framework

PAC-Bayes is a useful framework for deriving generalization bounds which...
research
10/10/2019

Still no free lunches: the price to pay for tighter PAC-Bayes bounds

"No free lunch" results state the impossibility of obtaining meaningful ...
research
02/11/2022

Controlling Confusion via Generalisation Bounds

We establish new generalisation bounds for multiclass classification by ...
research
02/07/2023

A unified recipe for deriving (time-uniform) PAC-Bayes bounds

We present a unified framework for deriving PAC-Bayesian generalization ...
research
05/07/2014

PAC-Bayes Mini-tutorial: A Continuous Union Bound

When I first encountered PAC-Bayesian concentration inequalities they se...
research
06/21/2014

PAC-Bayes Analysis of Multi-view Learning

This paper presents eight PAC-Bayes bounds to analyze the generalization...
research
07/01/2022

Integral Probability Metrics PAC-Bayes Bounds

We present a PAC-Bayes-style generalization bound which enables the repl...

Please sign up or login with your details

Forgot password? Click here to reset