Variations on a Theme by Massey

02/08/2021
by   Olivier Rioul, et al.
0

In 1994, James Lee Massey proposed the guessing entropy as a measure of the difficulty that an attacker has to guess a secret used in a cryptographic system, and established a well-known inequality between entropy and guessing entropy. Over 15 years before, in an unpublished work, he also established a well-known inequality for the entropy of an integer-valued random variable of given variance. In this paper, we establish a link between the two works by Massey in the more general framework of the relationship between discrete (absolute) entropy and continuous (differential) entropy. Two approaches are given in which the discrete entropy (or Rényi entropy) of and integer-valued variable can be upper bounded using the differential (Rényi) entropy of some suitably chosen continuous random variable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2020

Prove Costa's Entropy Power Inequality and High Order Inequality for Differential Entropy with Semidefinite Programming

Costa's entropy power inequality is an important generalization of Shann...
research
07/09/2021

Information cohomology of classical vector-valued observables

We provide here a novel algebraic characterization of two information me...
research
10/03/2022

Reconciling econometrics with continuous maximum-entropy models

In the study of economic networks, econometric approaches interpret the ...
research
05/29/2018

Error Bounds on a Mixed Entropy Inequality

Motivated by the entropy computations relevant to the evaluation of decr...
research
05/29/2018

The deficit in an entropic inequality

In this article, we investigate the entropy of a sum of a discrete and a...
research
12/18/2022

Entropy-variance inequalities for discrete log-concave random variables via degree of freedom

We utilize a discrete version of the notion of degree of freedom to prov...
research
11/07/2019

Deriving pairwise transfer entropy from network structure and motifs

Transfer entropy is an established method for quantifying directed stati...

Please sign up or login with your details

Forgot password? Click here to reset