Variations on a Theme by Massey

by   Olivier Rioul, et al.

In 1994, James Lee Massey proposed the guessing entropy as a measure of the difficulty that an attacker has to guess a secret used in a cryptographic system, and established a well-known inequality between entropy and guessing entropy. Over 15 years before, in an unpublished work, he also established a well-known inequality for the entropy of an integer-valued random variable of given variance. In this paper, we establish a link between the two works by Massey in the more general framework of the relationship between discrete (absolute) entropy and continuous (differential) entropy. Two approaches are given in which the discrete entropy (or Rényi entropy) of and integer-valued variable can be upper bounded using the differential (Rényi) entropy of some suitably chosen continuous random variable.



page 1

page 2

page 3

page 4


Prove Costa's Entropy Power Inequality and High Order Inequality for Differential Entropy with Semidefinite Programming

Costa's entropy power inequality is an important generalization of Shann...

Information cohomology of classical vector-valued observables

We provide here a novel algebraic characterization of two information me...

The deficit in an entropic inequality

In this article, we investigate the entropy of a sum of a discrete and a...

Error Bounds on a Mixed Entropy Inequality

Motivated by the entropy computations relevant to the evaluation of decr...

An Exact Upper Bound on the L^p Lebesgue Constant and The ∞-Rényi Entropy Power Inequality for Integer Valued Random Variables

In this paper, we proved an exact asymptotically sharp upper bound of th...

Entropy and Syntropy in the Context of Five-Valued Logics

This paper presents a five-valued representation of bifuzzy sets. This r...

Deriving pairwise transfer entropy from network structure and motifs

Transfer entropy is an established method for quantifying directed stati...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.