Negative Shannon Information Hides Networks

06/09/2022
by   Ming-Xing Luo, et al.
0

Negative numbers are essential in mathematics. They are not needed to describe statistical experiments, as those are expressed in terms of positive probabilities. Shannon information was firstly defined for characterizing informational uncertainty of classical probabilistic distributions. However, it is unknown why there is negative information for more than two random variables on finite sample spaces. We first show the negative Shannon mutual information of three random variables implies Bayesian network representations of its joint distribution. We then show the intrinsic compatibility with negative Shannon information is generic for Bayesian networks with quantum realizations. This further suggests a new kind of space-dependent nonlocality. The present result provides a device-independent witness of negative Shannon information.

READ FULL TEXT

page 1

page 11

page 13

research
07/11/2019

Generalized Mutual Information

Mutual information is one of the essential building blocks of informatio...
research
06/23/2021

An Effective Bernstein-type Bound on Shannon Entropy over Countably Infinite Alphabets

We prove a Bernstein-type bound for the difference between the average o...
research
02/18/2022

Information Decomposition Diagrams Applied beyond Shannon Entropy: A Generalization of Hu's Theorem

In information theory, one major goal is to find useful functions that s...
research
04/23/2022

Continuity and Additivity Properties of Information Decompositions

Information decompositions quantify how the Shannon information about a ...
research
07/15/2013

Decision Making for Inconsistent Expert Judgments Using Negative Probabilities

In this paper we provide a simple random-variable example of inconsisten...
research
02/25/2018

The maximum negative hypergeometric distribution

An urn contains a known number of balls of two different colors. We desc...
research
09/08/2018

Hybrid Statistical Estimation of Mutual Information and its Application to Information Flow

Analysis of a probabilistic system often requires to learn the joint pro...

Please sign up or login with your details

Forgot password? Click here to reset