Measurability Aspects of the Compactness Theorem for Sample Compression Schemes

05/25/2012
by   Damjan Kalajdzievski, et al.
0

It was proved in 1998 by Ben-David and Litman that a concept space has a sample compression scheme of size d if and only if every finite subspace has a sample compression scheme of size d. In the compactness theorem, measurability of the hypotheses of the created sample compression scheme is not guaranteed; at the same time measurability of the hypotheses is a necessary condition for learnability. In this thesis we discuss when a sample compression scheme, created from com- pression schemes on finite subspaces via the compactness theorem, have measurable hypotheses. We show that if X is a standard Borel space with a d-maximum and universally separable concept class C, then (X,C) has a sample compression scheme of size d with universally Borel measurable hypotheses. Additionally we introduce a new variant of compression scheme called a copy sample compression scheme.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/11/2022

Optimally compressing VC classes

Resolving a conjecture of Littlestone and Warmuth, we show that any conc...
research
08/12/2023

Multiclass Learnability Does Not Imply Sample Compression

A hypothesis class admits a sample compression scheme, if for every samp...
research
10/11/2022

Unlabelled Sample Compression Schemes for Intersection-Closed Classes and Extremal Classes

The sample compressibility of concept classes plays an important role in...
research
12/24/2022

A Labelled Sample Compression Scheme of Size at Most Quadratic in the VC Dimension

This paper presents a construction of a proper and stable labelled sampl...
research
06/14/2015

Artificial general intelligence through recursive data compression and grounded reasoning: a position paper

This paper presents a tentative outline for the construction of an artif...
research
11/18/2009

A Geometric Approach to Sample Compression

The Sample Compression Conjecture of Littlestone & Warmuth has remained ...
research
12/05/2018

Unlabeled sample compression schemes and corner peelings for ample and maximum classes

We examine connections between combinatorial notions that arise in machi...

Please sign up or login with your details

Forgot password? Click here to reset