Universal Coding and Prediction on Martin-Löf Random Points

05/07/2020
by   Łukasz Dębowski, et al.
0

We perform an effectivization of classical results concerning universal coding and prediction for stationary ergodic processes over an arbitrary finite alphabet. That is, we lift the well-known almost sure statements to statements about Martin-Löf random sequences. Most of this work is quite mechanical but, by the way, we complete a result of Ryabko from 2008 by showing that each universal probability measure in the sense of universal coding induces a universal predictor in the prequential sense. Surprisingly, the effectivization of this implication holds true provided the universal measure does not ascribe too low conditional probabilities to individual symbols. As an example, we show that the Prediction by Partial Matching (PPM) measure satisfies this requirement. In the almost sure setting, the requirement is superfluous.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/24/2022

Universal Densities Exist for Every Finite Reference Measure

As it is known, universal codes, which estimate the entropy rate consist...
research
10/24/2022

On Universality of the S Combinator

In combinatory logic it is known that the set of two combinators K and S...
research
11/01/2021

Individual codewords

Algorithmic information theory translates statements about classes of ob...
research
08/09/2014

Characterizing predictable classes of processes

The problem is sequence prediction in the following setting. A sequence ...
research
12/23/2022

A Universal Random Coding Ensemble for Sample-wise Lossy Compression

We propose a universal ensemble for random selection of rate-distortion ...
research
07/23/2020

The MMI Decoder is Asymptotically Optimal for the Typical Random Code and for the Expurgated Code

We provide two results concerning the optimality of the maximum mutual i...
research
01/29/2001

The Generalized Universal Law of Generalization

It has been argued by Shepard that there is a robust psychological law t...

Please sign up or login with your details

Forgot password? Click here to reset