Minimal Joint Entropy and Order-Preserving Couplings

06/08/2022

∙

This paper focuses on the extreme-value problem for Shannon entropy of the joint distribution with given marginals. It is proved that the minimum-entropy coupling must be of order-preserving, while the maximum-entropy coupling coincides with the independent one. Note that in this sense, we interpret entropy as a measure of system disorder.

READ FULL TEXT

Minimal Joint Entropy and Order-Preserving Couplings

Efficient Approximate Minimum Entropy Coupling of Multiple Probability Distributions

To Reduce Gross NPA and Classify Defaulters Using Shannon Entropy

Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines

Asymptotic Coupling and Its Applications in Information Theory

A note on power generalized extreme value distribution and its properties

Distance entropy cartography characterises centrality in complex networks

Perfectly Secure Steganography Using Minimum Entropy Coupling

Minimal Joint Entropy and Order-Preserving Couplings

Related Research

Efficient Approximate Minimum Entropy Coupling of Multiple Probability Distributions

To Reduce Gross NPA and Classify Defaulters Using Shannon Entropy

Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines

Asymptotic Coupling and Its Applications in Information Theory

A note on power generalized extreme value distribution and its properties

Distance entropy cartography characterises centrality in complex networks

Perfectly Secure Steganography Using Minimum Entropy Coupling