When the map is better than the territory

12/30/2016
by   Erik P Hoel, et al.
0

The causal structure of any system can be analyzed at a multitude of spatial and temporal scales. It has long been thought that while higher scale (macro) descriptions of causal structure may be useful to observers, they are at best a compressed description and at worse leave out critical information. However, recent research applying information theory to causal analysis has shown that the causal structure of some systems can actually come into focus (be more informative) at a macroscale (Hoel et al. 2013). That is, a macro model of a system (a map) can be more informative than a fully detailed model of the system (the territory). This has been called causal emergence. While causal emergence may at first glance seem counterintuitive, this paper grounds the phenomenon in a classic concept from information theory: Shannon's discovery of the channel capacity. I argue that systems have a particular causal capacity, and that different causal models of those systems take advantage of that capacity to various degrees. For some systems, only macroscale causal models use the full causal capacity. Such macroscale causal models can either be coarse-grains, or may leave variables and states out of the model (exogenous) in various ways, which can improve the model's efficacy and its informativeness via the same mathematical principles of how error-correcting codes take advantage of an information channel's capacity. As model choice increase, the causal capacity of a system approaches the channel capacity. Ultimately, this provides a general framework for understanding how the causal structure of some systems cannot be fully captured by even the most detailed microscopic model.

READ FULL TEXT

page 4

page 7

page 12

research
01/25/2022

Neural Information Squeezer for Causal Emergence

The classic studies of causal emergence have revealed that in some Marko...
research
03/31/2020

A macro agent and its actions

In science, macro level descriptions of the causal interactions within c...
research
12/03/2022

The Cause of Causal Emergence: Redistribution of Uncertainty

It is crucial to choose the appropriate scale in order to build an effec...
research
08/19/2023

Finding emergence in data: causal emergence inspired dynamics learning

Modelling complex dynamical systems in a data-driven manner is challengi...
research
02/03/2022

Causal emergence is widespread across measures of causation

Causal emergence is the theory that macroscales can reduce the noise in ...
research
10/19/2020

Causal Geometry

Information geometry has offered a way to formally study the efficacy of...
research
12/08/2022

A probabilistic autoencoder for causal discovery

The paper addresses the problem of finding the causal direction between ...

Please sign up or login with your details

Forgot password? Click here to reset