An improved estimate of the inverse binary entropy function

05/05/2020
by   Reginald D. Smith, et al.
0

Two estimates for the inverse binary entropy function are derived using the property of information entropy to estimate combinatorics of sequences as well as related formulas from population genetics for the effective number of alleles. The second estimate shows close correspondence to the actual value of the inverse binary entropy function and can be seen as a close approximation away from low values of binary entropy where p or 1-p are small.

READ FULL TEXT
research
03/11/2020

Entropy of tropical holonomic sequences

We introduce tropical holonomic sequences of a given order and calculate...
research
11/14/2018

The case for shifting the Renyi Entropy

We introduce a variant of the Rényi entropy definition that aligns it wi...
research
01/23/2023

A Useful Inequality for the Binary Entropy Function

We provide a simple proof of a curious inequality for the binary entropy...
research
02/15/2022

On the entropy numbers and the Kolmogorov widths

Direct estimates between linear or nonlinear Kolmogorov widths and entro...
research
11/11/2022

Theoretical error estimates for computing the matrix logarithm by Padé-type approximants

In this article, we focus on the error that is committed when computing ...
research
03/13/2018

Narcissus: Deriving Correct-By-Construction Decoders and Encoders from Binary Formats

Every injective function has an inverse, although constructing the inver...
research
05/23/2018

Determining the Number of Samples Required to Estimate Entropy in Natural Sequences

Calculating the Shannon entropy for symbolic sequences has been widely c...

Please sign up or login with your details

Forgot password? Click here to reset