From Babel to Boole: The Logical Organization of Information Decompositions

06/01/2023
by   Aaron J. Gutknecht, et al.
0

The conventional approach to the general Partial Information Decomposition (PID) problem has been redundancy-based: specifying a measure of redundant information between collections of source variables induces a PID via Moebius-Inversion over the so called redundancy lattice. Despite the prevalence of this method, there has been ongoing interest in examining the problem through the lens of different base-concepts of information, such as synergy, unique information, or union information. Yet, a comprehensive understanding of the logical organization of these different based-concepts and their associated PIDs remains elusive. In this work, we apply the mereological formulation of PID that we introduced in a recent paper to shed light on this problem. Within the mereological approach base-concepts can be expressed in terms of conditions phrased in formal logic on the specific parthood relations between the PID components and the different mutual information terms. We set forth a general pattern of these logical conditions of which all PID base-concepts in the literature are special cases and that also reveals novel base-concepts, in particular a concept we call “vulnerable information”.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2020

Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic

Partial information decomposition (PID) seeks to decompose the multivari...
research
01/27/2018

Pointwise Information Decomposition Using the Specificity and Ambiguity Lattices

What are the distinct ways in which a set of predictor variables can pro...
research
10/14/2019

Information Decomposition based on Cooperative Game Theory

We offer a new approach to the information decomposition problem in info...
research
08/23/2019

A novel approach to multivariate redundancy and synergy

Consider a situation in which a set of n "source" random variables X_1,....
research
06/27/2017

Invariant components of synergy, redundancy, and unique information among three variables

In a system of three stochastic variables, the Partial Information Decom...
research
01/25/2023

Towards a Unification of Logic and Information Theory

We examine the problem of efficient transmission of logical statements f...
research
11/13/2017

The identity of information: how deterministic dependencies constrain information synergy and redundancy

Understanding how different information sources together transmit inform...

Please sign up or login with your details

Forgot password? Click here to reset