Neural Information Squeezer for Causal Emergence

01/25/2022
by   Jiang Zhang, et al.
0

The classic studies of causal emergence have revealed that in some Markovian dynamical systems, far stronger causal connections can be found on the higher-level descriptions than the lower-level of the same systems if we coarse-grain the system states in an appropriate way. However, identifying this emergent causality from the data is still a hard problem that has not been solved because the correct coarse-graining strategy can not be found easily. This paper proposes a general machine learning framework called Neural Information Squeezer to automatically extract the effective coarse-graining strategy and the macro-state dynamics, as well as identify causal emergence directly from the time series data. By decomposing a coarse-graining operation into two processes: information conversion and information dropping out, we can not only exactly control the width of the information channel, but also can derive some important properties analytically including the exact expression of the effective information of a macro-dynamics. We also show how our framework can extract the dynamics on different levels and identify causal emergence from the data on several exampled systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2023

Finding emergence in data: causal emergence inspired dynamics learning

Modelling complex dynamical systems in a data-driven manner is challengi...
research
12/03/2022

The Cause of Causal Emergence: Redistribution of Uncertainty

It is crucial to choose the appropriate scale in order to build an effec...
research
12/30/2016

When the map is better than the territory

The causal structure of any system can be analyzed at a multitude of spa...
research
08/15/2019

How Downwards Causation Occurs in Digital Computers

Digital computers carry out algorithms coded in high level programs. The...
research
03/31/2020

A macro agent and its actions

In science, macro level descriptions of the causal interactions within c...
research
02/03/2022

Causal emergence is widespread across measures of causation

Causal emergence is the theory that macroscales can reduce the noise in ...
research
05/31/2021

Emergence and algorithmic information dynamics of systems and observers

Previous work has shown that perturbation analysis in software space can...

Please sign up or login with your details

Forgot password? Click here to reset