Optimal high-level descriptions of dynamical systems

09/25/2014
by   David H. Wolpert, et al.
0

To analyze high-dimensional systems, many fields in science and engineering rely on high-level descriptions, sometimes called "macrostates," "coarse-grainings," or "effective theories". Examples of such descriptions include the thermodynamic properties of a large collection of point particles undergoing reversible dynamics, the variables in a macroeconomic model describing the individuals that participate in an economy, and the summary state of a cell composed of a large set of biochemical networks. Often these high-level descriptions are constructed without considering the ultimate reason for needing them in the first place. Here, we formalize and quantify one such purpose: the need to predict observables of interest concerning the high-dimensional system with as high accuracy as possible, while minimizing the computational cost of doing so. The resulting State Space Compression (SSC) framework provides a guide for how to solve for the optimal high-level description of a given dynamical system, rather than constructing it based on human intuition alone. In this preliminary report, we introduce SSC, and illustrate it with several information-theoretic quantifications of "accuracy", all with different implications for the optimal compression. We also discuss some other possible applications of SSC beyond the goal of accurate prediction. These include SSC as a measure of the complexity of a dynamical system, and as a way to quantify information flow between the scales of a system.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/18/2021

Information-theoretic formulation of dynamical systems: causality, modeling, and control

The problems of causality, modeling, and control for chaotic, high-dimen...
research
06/04/2020

Severability of mesoscale components and local time scales in dynamical networks

A major goal of dynamical systems theory is the search for simplified de...
research
01/15/2010

Scalable Bayesian reduced-order models for high-dimensional multiscale dynamical systems

While existing mathematical descriptions can accurately account for phen...
research
08/27/2022

Deep Kernel Learning of Dynamical Models from High-Dimensional Noisy Data

This work proposes a Stochastic Variational Deep Kernel Learning method ...
research
06/28/2023

Emulating the dynamics of complex systems using autoregressive models on manifolds (mNARX)

In this study, we propose a novel surrogate modelling approach to effici...
research
04/17/2018

Structured networks and coarse-grained descriptions: a dynamical perspective

This chapter discusses the interplay between structure and dynamics in c...
research
02/13/2023

Sources of Richness and Ineffability for Phenomenally Conscious States

Conscious states (states that there is something it is like to be in) se...

Please sign up or login with your details

Forgot password? Click here to reset