The Birthday Problem and Zero-Error List Codes

02/13/2018
by   Parham Noorzad, et al.
0

As an attempt to bridge the gap between classical information theory and the combinatorial world of zero-error information theory, this paper studies the performance of randomly generated codebooks over discrete memoryless channels under a zero-error constraint. This study allows the application of tools from one area to the other. Furthermore, it leads to an information-theoretic formulation of the birthday problem, which is concerned with the probability that in a given population, a fixed number of people have the same birthday. Due to the lack of a closed-form expression for this probability when the distribution of birthdays is not uniform, the resulting computation is not feasible in some applications; the information-theoretic formulation, however, can be analyzed for all distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2022

Information-Theoretic Analysis of Minimax Excess Risk

Two main concepts studied in machine learning theory are generalization ...
research
11/06/2019

On Data-Processing and Majorization Inequalities for f-Divergences with Applications

This paper is focused on derivations of data-processing and majorization...
research
02/21/2022

On the Information-theoretic Security of Combinatorial All-or-nothing Transforms

All-or-nothing transforms (AONT) were proposed by Rivest as a message pr...
research
04/11/2022

Information in probability: Another information-theoretic proof of a finite de Finetti theorem

We recall some of the history of the information-theoretic approach to d...
research
01/27/2021

Variational Encoders and Autoencoders : Information-theoretic Inference and Closed-form Solutions

This work develops problem statements related to encoders and autoencode...
research
08/10/2018

Genome-Wide Association Studies: Information Theoretic Limits of Reliable Learning

In the problems of Genome-Wide Association Study (GWAS), the objective i...
research
01/16/2018

On the Direction of Discrimination: An Information-Theoretic Analysis of Disparate Impact in Machine Learning

In the context of machine learning, disparate impact refers to a form of...

Please sign up or login with your details

Forgot password? Click here to reset