The Input and Output Entropies of the k-Deletion/Insertion Channel

02/07/2022
by   Shubhransh Singhvi, et al.
0

The channel output entropy of a transmitted word is the entropy of the possible channel outputs and similarly the input entropy of a received word is the entropy of all possible transmitted words. The goal of this work is to study these entropy values for the k-deletion, k-insertion channel, where exactly k symbols are deleted, inserted in the transmitted word, respectively. If all possible words are transmitted with the same probability then studying the input and output entropies is equivalent. For both the 1-insertion and 1-deletion channels, it is proved that among all words with a fixed number of runs, the input entropy is minimized for words with a skewed distribution of their run lengths and it is maximized for words with a balanced distribution of their run lengths. Among our results, we establish a conjecture by Atashpendar et al. which claims that for the binary 1-deletion channel, the input entropy is maximized for the alternating words.

READ FULL TEXT
01/15/2020

The Error Probability of Maximum-Likelihood Decoding over Two Deletion Channels

This paper studies the problem of reconstructing a word given several of...
02/08/2022

An Exploration of a New Group of Channel Symmetries

We study a certain symmetry group associated to any given communication ...
07/30/2018

A Proof of Entropy Minimization for Outputs in Deletion Channels via Hidden Word Statistics

From the output produced by a memoryless deletion channel from a uniform...
02/02/2018

From Clustering Supersequences to Entropy Minimizing Subsequences for Single and Double Deletions

A binary string transmitted via a memoryless i.i.d. deletion channel is ...
02/22/2020

Extracting and Validating Explanatory Word Archipelagoes using Dual Entropy

The logical connectivity of text is represented by the connectivity of w...
03/25/2020

From Information Theory Puzzles in Deletion Channels to Deniability in Quantum Cryptography

From the output produced by a memoryless deletion channel with a uniform...
01/06/2020

Communication-Channel Optimized Partition

Given an original discrete source X with the distribution p_X that is co...