Localized Complexities for Transductive Learning

11/26/2014
by   Ilya Tolstikhin, et al.
0

We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have broad applications in learning theory in general, we exemplify their significance by studying the transductive setting of learning theory. For which we provide the first excess risk bounds based on the localized complexity of the hypothesis class, which can yield fast rates of convergence also in the transductive learning setting. We give a preliminary analysis of the localized complexities for the prominent case of kernel classes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2020

Towards Optimal Problem Dependent Generalization Error Bounds in Statistical Learning Theory

We study problem-dependent rates, i.e., generalization errors that scale...
research
07/05/2017

Early stopping for kernel boosting algorithms: A general analysis with localized complexities

Early stopping of iterative algorithms is a widely-used form of regulari...
research
06/06/2018

Rademacher complexity for Markov chains : Applications to kernel smoothing and Metropolis-Hasting

Following the seminal approach by Talagrand, the concept of Rademacher c...
research
08/24/2021

Constraining Localized Vote Tampering in the 2020 US Presidential Election

Voter fraud in the United States is rare and the vote-counting system is...
research
07/19/2016

Distribution-dependent concentration inequalities for tighter generalization bounds

Concentration inequalities are indispensable tools for studying the gene...
research
10/20/2020

Inequalities for space-bounded Kolmogorov complexity

There is a parallelism between Shannon information theory and algorithmi...
research
10/06/2015

Local Rademacher Complexity Bounds based on Covering Numbers

This paper provides a general result on controlling local Rademacher com...

Please sign up or login with your details

Forgot password? Click here to reset