On the Conditional Smooth Renyi Entropy and its Applications in Guessing and Source Coding

10/22/2018
by   Shigeaki Kuzuoka, et al.
0

A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate to give lower and upper bounds on the optimal guessing moment in a guessing problem where the guesser is allowed to stop guessing and declare an error. Further a general formula for the optimal guessing exponent is given. In particular, a single-letterized formula for mixture of i.i.d. sources is obtained. Another application in the problem of source coding with the common side-information available at the encoder and decoder is also demonstrated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/11/2020

Asymptotic Expansions of Smooth Rényi Entropies and Their Applications

This study considers the unconditional smooth Rényi entropy, the smooth ...
research
06/08/2021

Entropy of the Conditional Expectation under Gaussian Noise

This paper considers an additive Gaussian noise channel with arbitrarily...
research
09/01/2022

Conditional graph entropy as an alternating minimization problem

The systematic study of alternating minimization problems was initiated ...
research
04/11/2022

Why Shape Coding? Asymptotic Analysis of the Entropy Rate for Digital Images

This paper focuses on the ultimate limit theory of image compression. It...
research
04/29/2020

Rényi Bounds on Information Combining

Bounds on information combining are entropic inequalities that determine...
research
05/21/2020

Sharp Second-Order Pointwise Asymptotics for Lossless Compression with Side Information

The problem of determining the best achievable performance of arbitrary ...
research
12/12/2019

Fundamental Limits of Lossless Data Compression with Side Information

The problem of lossless data compression with side information available...

Please sign up or login with your details

Forgot password? Click here to reset