Approximate Discrete Entropy Monotonicity for Log-Concave Sums

10/12/2022
by   Lampros Gavalakis, et al.
0

It is proved that for any n ≥ 1, if X_1,…,X_n are i.i.d. integer-valued, log-concave random variables then h(X_1+…+X_n + U_1+…+U_n) = H(X_1+…+X_n) + o(1), as H(X_1) →∞, where h stands for the differential entropy, H dentoes the (discrete) Shannon entropy and U_1,…,U_n are independent continuous uniforms on (0,1). As a corollary, it is shown that a conjecture of Tao (2010) holds true for log-concave random variables on the integers: H(X_1+…+X_n+1) ≥ H(X_1+⋯+X_n) + 1/2log(n+1/n) - o(1) as H(X_1) →∞. Explicit bounds for the o(1)-terms are provided.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2023

Minimum entropy of a log-concave variable for fixed variance

We show that for log-concave real random variables with fixed variance t...
research
03/17/2019

Stability of the Shannon-Stam inequality via the Föllmer process

We prove stability estimates for the Shannon-Stam inequality (also known...
research
07/17/2020

Lower Bound on Derivatives of Costa's Differential Entropy

Several conjectures concern the lower bound for the differential entropy...
research
04/20/2022

An entropy functional bounded from above by one

Shannon entropy is widely used for quantifying uncertainty in discrete r...
research
05/21/2020

Reversals of Rényi Entropy Inequalities under Log-Concavity

We establish a discrete analog of the Rényi entropy comparison due to Bo...
research
08/13/2018

On the Shannon entropy of the number of vertices with zero in-degree in randomly oriented hypergraphs

Suppose that you have n colours and m mutually independent dice, each of...
research
01/16/2020

Constrained Functional Value under General Convexity Conditions with Applications to Distributed Simulation

We show a general phenomenon of the constrained functional value for den...

Please sign up or login with your details

Forgot password? Click here to reset