Emergence as the conversion of information: A unifying theory

04/27/2021
by   Thomas Varley, et al.
0

Is reduction always a good scientific strategy? Does it always lead to a gain in information? The very existence of the special sciences above and beyond physics seems to hint no. Previous research has shown that dimension reduction (macroscales) can increase the dependency between elements of a system (a phenomenon called "causal emergence"). However, this has been shown only for specific measures like effective information or integrated information. Here, we provide an umbrella mathematical framework for emergence based on information conversion. Specifically, we show evidence that a macroscale can have more of a certain type of information than its underlying microscale. This is because macroscales can convert information from one type to another. In such cases, reduction to a microscale means the loss of this type of information. We demonstrate this using the well-understood mutual information measure applied to Boolean networks. By using the partial information decomposition, the mutual information can be decomposed into redundant, unique, and synergistic information atoms. Then by introducing a novel measure of the synergy bias of a given decomposition, we are able to show that the synergy component of a Boolean network's mutual information can increase at macroscales. This can occur even when there is no difference in the total mutual information between a macroscale and its underlying microscale, proving information conversion. We relate this broad framework to previous work, compare it to other theories, and argue it complexifies any notion of universal reduction in the sciences, since such reduction would likely lead to a loss of synergistic information in scientific models.

READ FULL TEXT
research
08/30/2022

Flickering emergences: The question of locality in information-theoretic approaches to emergence

"Emergence", the phenomenon where a complex system displays properties, ...
research
02/09/2020

A differentiable measure of pointwise shared information

Partial information decomposition (PID) of the multivariate mutual infor...
research
07/23/2021

On shared and multiple information

We address three outstanding problems in information theory. Problem one...
research
05/31/2021

Emergence and algorithmic information dynamics of systems and observers

Previous work has shown that perturbation analysis in software space can...
research
02/03/2022

Causal emergence is widespread across measures of causation

Causal emergence is the theory that macroscales can reduce the noise in ...
research
05/11/2023

Computing Unique Information for Poisson and Multinomial Systems

Bivariate Partial Information Decomposition (PID) describes how the mutu...
research
03/21/2019

Decomposing information into copying versus transformation

In many real-world systems, information can be transmitted in two qualit...

Please sign up or login with your details

Forgot password? Click here to reset