Orders between channels and some implications for partial information decomposition

05/10/2023
by   André F. C. Gomes, et al.
0

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. Inspired by Kolchinsky's recent proposal for measures of intersection information, we introduce three new measures based on well-known partial orders between communication channels and study some of their properties.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/10/2019

MAXENT3D_PID: An Estimator for the Maximum-entropy Trivariate Partial Information Decomposition

Chicharro (2017) introduced a procedure to determine multivariate partia...
research
06/14/2023

System Information Decomposition

In order to characterize complex higher-order interactions among variabl...
research
08/23/2019

A novel approach to multivariate redundancy and synergy

Consider a situation in which a set of n "source" random variables X_1,....
research
10/26/2022

Extracting Unique Information Through Markov Relations

We propose two new measures for extracting the unique information in X a...
research
07/13/2018

Unique Informations and Deficiencies

Given two channels that convey information about the same random variabl...
research
06/27/2017

Invariant components of synergy, redundancy, and unique information among three variables

In a system of three stochastic variables, the Partial Information Decom...
research
05/11/2023

Computing Unique Information for Poisson and Multinomial Systems

Bivariate Partial Information Decomposition (PID) describes how the mutu...

Please sign up or login with your details

Forgot password? Click here to reset