research
∙
09/08/2023
Generalization Bounds: Perspectives from Information Theory and PAC-Bayes
A fundamental question in theoretical machine learning is generalization...
share
research
∙
02/16/2023
Adaptive Selective Sampling for Online Prediction with Experts
We consider online prediction of a binary sequence with expert advice. F...
research
∙
10/12/2022
Evaluated CMI Bounds for Meta Learning: Tightness and Expressiveness
Recent work has established that the conditional mutual information (CMI...
research
∙
10/12/2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI
We present a new family of information-theoretic generalization bounds, ...
research
∙
10/22/2020
Nonvacuous Loss Bounds with Fast Rates for Neural Networks via Conditional Information Measures
We present a framework to derive bounds on the test loss of randomized l...
research
∙
05/16/2020
Generalization Bounds via Information Density and Conditional Information Density
We present a general approach, based on an exponential inequality, to de...
research
∙
04/20/2020