A Tighter Upper Bound of the Expansion Factor for Universal Coding of Integers and Its Code Constructions

09/18/2021
by   Wei Yan, et al.
0

In entropy coding, universal coding of integers (UCI) is a binary universal prefix code, such that the ratio of the expected codeword length to max{1, H(P)} is less than or equal to a constant expansion factor K_𝒞 for any probability distribution P, where H(P) is the Shannon entropy of P. K_𝒞^* is the infimum of the set of expansion factors. The optimal UCI is defined as a class of UCI possessing the smallest K_𝒞^*. Based on prior research, the range of K_𝒞^* for the optimal UCI is 2≤ K_𝒞^*≤ 2.75. Currently, the code constructions achieve K_𝒞=2.75 for UCI and K_𝒞=3.5 for asymptotically optimal UCI. In this paper, we propose a class of UCI, termed ι code, to achieve K_𝒞=2.5. This further narrows the range of K_𝒞^* to 2≤ K_𝒞^*≤ 2.5. Next, a family of asymptotically optimal UCIs is presented, where their expansion factor infinitely approaches 2.5. Finally, a more precise range of K_𝒞^* for the classic UCIs is discussed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/15/2022

Generalized Universal Coding of Integers

Universal coding of integers (UCI) is a class of variable-length code, s...
research
06/08/2020

Optimal Work Extraction and the Minimum Description Length Principle

We discuss work extraction from classical information engines (e.g., Szi...
research
03/10/2020

On a Class of Markov Order Estimators Based on PPM and Other Universal Codes

We investigate a class of estimators of the Markov order for stationary ...
research
08/24/2022

Singleton-optimal (r,δ)-LRCs via some good polynomials of special forms

RS-like locally repairable codes (LRCs) based on polynomial evaluation w...
research
11/01/2018

Semi-Finite Length Analysis for Information Theoretic Tasks

We focus on the optimal value for various information-theoretical tasks....
research
06/12/2019

On Universal Codes for Integers: Wallace Tree, Elias Omega and Variations

A universal code for the (positive) integers can be used to store or com...
research
09/15/2019

Run-Length Encoding in a Finite Universe

Text compression schemes and compact data structures usually combine sop...

Please sign up or login with your details

Forgot password? Click here to reset