Modes of Information Flow

08/21/2018
by   Ryan G. James, et al.
0

Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems. We demonstrate three modalities of information flow from time series X to time series Y. Intrinsic information flow exists when the past of X is individually predictive of the present of Y, independent of Y's past; this is most commonly considered information flow. Shared information flow exists when X's past is predictive of Y's present in the same manner as Y's past; this occurs due to synchronization or common driving, for example. Finally, synergistic information flow occurs when neither X's nor Y's pasts are predictive of Y's present on their own, but taken together they are. The two most broadly-employed information-theoretic methods of quantifying information flow---time-delayed mutual information and transfer entropy---are both sensitive to a pair of these modalities: time-delayed mutual information to both intrinsic and shared flow, and transfer entropy to both intrinsic and synergistic flow. To quantify each mode individually we introduce our cryptographic flow ansatz, positing that intrinsic flow is synonymous with secret key agreement between X and Y. Based on this, we employ an easily-computed secret-key-agreement bound---intrinsic mutual information&mdashto quantify the three flow modalities in a variety of systems including asymmetric flows and financial markets.

READ FULL TEXT
research
12/16/2019

ITENE: Intrinsic Transfer Entropy Neural Estimator

Quantifying the directionality of information flow is instrumental in un...
research
04/28/2020

Communication Complexity of the Secret Key Agreement in Algorithmic Information Theory

It is known that the mutual information, in the sense of Kolmogorov comp...
research
10/09/2012

Quantifying Causal Coupling Strength: A Lag-specific Measure For Multivariate Time Series Related To Transfer Entropy

While it is an important problem to identify the existence of causal ass...
research
02/04/2021

Cumulant Expansion of Mutual Information for Quantifying Leakage of a Protected Secret

The information leakage of a cryptographic implementation with a given d...
research
03/22/2022

Causal inference in time series in terms of Rényi transfer entropy

Uncovering causal interdependencies from observational data is one of th...
research
09/06/2018

One-Shot Variable-Length Secret Key Agreement Approaching Mutual Information

This paper studies an information-theoretic one-shot variable-length sec...
research
08/26/2018

A Perspective on Unique Information: Directionality, Intuitions, and Secret Key Agreement

Recently, the partial information decomposition emerged as a promising f...

Please sign up or login with your details

Forgot password? Click here to reset