Conditional Rényi entropy and the relationships between Rényi capacities

05/02/2020
by   Gautam Aishwarya, et al.
0

The analogues of Arimoto's definition of conditional Rényi entropy and Rényi mutual information are explored for abstract alphabets. These quantities, although dependent on the reference measure, have some useful properties similar to those known in the discrete setting. In addition to laying out some such basic properties and the relations to Rényi divergences, the relationships between the families of mutual informations defined by Sibson, Augustin-Csiszár, and Lapidoth-Pfister, as well as the corresponding capacities, are explored.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2023

A Logarithmic Decomposition for Information

The Shannon entropy of a random variable X has much behaviour analogous ...
research
07/14/2022

Analytic relations between networks: encoding, decoding, and causality

Networks are common in physics, biology, computer science, and social sc...
research
06/27/2020

Submodular Combinatorial Information Measures with Applications in Machine Learning

Information-theoretic quantities like entropy and mutual information hav...
research
06/19/2021

Rényi divergence inequalities via interpolation, with applications to generalised entropic uncertainty relations

We investigate quantum Rényi entropic quantities, specifically those der...
research
07/06/2020

Confounding Ghost Channels and Causality: A New Approach to Causal Information Flows

Information theory provides a fundamental framework for the quantificati...
research
02/01/2021

On conditional Sibson's α-Mutual Information

In this work, we analyse how to define a conditional version of Sibson's...
research
02/05/2021

A Mutual Reference Shape for Segmentation Fusion and Evaluation

This paper proposes the estimation of a mutual shape from a set of diffe...

Please sign up or login with your details

Forgot password? Click here to reset