A Partial Information Decomposition Based on Causal Tensors

01/28/2020
by   David Sigtermans, et al.
0

We propose a partial information decomposition based on the newly introduced framework of causal tensors. The constituting nonnegative information terms follow naturally from this framework, in which the data processing inequality plays a fundamental role. Instead of describing cascades of relations in terms of inequalities, causal tensors allow for a description of cascades in terms of equalities, i.e., exact expressions of the resulting information theoretic divergences is possible. Our approach is firmly rooted in classical information theory, and no new “non-classical information theoretic” measures are needed.

READ FULL TEXT

page 1

page 2

page 3

research
07/04/2019

infotheory: A C++/Python package for multivariate information theoretic analysis

This paper introduces infotheory: a package that implements multivariate...
research
10/05/2020

Is Information Theory Inherently a Theory of Causation?

Information theory gives rise to a novel method for causal skeleton disc...
research
02/08/2019

Bernstein Concentration Inequalities for Tensors via Einstein Products

A generalization of the Bernstein matrix concentration inequality to ran...
research
10/05/2020

A new Framework for Causal Discovery

Many frameworks exist to infer cause and effect relations in complex non...
research
05/28/2021

Fragmentation; a Tool for Finding Information, Encryption and Data Flow in Systems

We introduce a new information-theoretic measure, fragmentation (F) whic...
research
04/22/2020

An information-theoretic approach to the analysis of location and co-location patterns

We propose a statistical framework to quantify location and co-location ...
research
12/24/2018

Integrity Constraints Revisited: From Exact to Approximate Implication

Integrity constraints such as functional dependences (FD), and multi-val...

Please sign up or login with your details

Forgot password? Click here to reset