Transportation Proofs of Rényi Entropy Power Inequalities

02/16/2019
by   Olivier Rioul, et al.
0

A framework for deriving Rényi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known Rényi EPIs and derive new ones, by unifying a multiplicative form with constant c and a modification with exponent α of previous works. An information-theoretic proof of the Dembo-Cover-Thomas inequality---equivalent to Young's convolutional inequality with optimal constants---is provided, based on properties of Rényi conditional and relative entropies and using transportation arguments from Gaussian densities. For log-concave densities, a transportation proof of a sharp varentropy bound is presented.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/07/2018

Rényi Entropy Power Inequalities via Normal Transport and Rotation

Following a recent proof of Shannon's entropy power inequality (EPI), a ...
research
01/30/2019

Transportation Proof of an inequality by Anantharam, Jog and Nair

Anantharam, Jog and Nair recently put forth an entropic inequality which...
research
06/11/2023

The capacity of quiver representations and the Anantharam-Jog-Nair inequality

The Anantharam-Jog-Nair inequality [AJN22] in Information Theory provide...
research
05/11/2020

Non-linear Log-Sobolev inequalities for the Potts semigroup and applications to reconstruction problems

Consider a Markov process with state space [k], which jumps continuously...
research
05/15/2021

On Conditional α-Information and its Application to Side-Channel Analysis

A conditional version of Sibson's α-information is defined using a simpl...
research
06/12/2020

On the optimal constants in the two-sided Stechkin inequalities

We address the optimal constants in the strong and the weak Stechkin ine...
research
09/01/2021

New Proofs of Extremal Inequalities With Applications

The extremal inequality approach plays a key role in network information...

Please sign up or login with your details

Forgot password? Click here to reset