The typical set and entropy in stochastic systems with arbitrary phase space growth

09/03/2021
by   Rudolf Hanel, et al.
0

The existence of the typical set is key for the consistence of the ensemble formalization of statistical mechanics. We demonstrate here that the typical set can be defined and characterized for a general class of stochastic processes. This includes processes showing arbitrary path dependence, long range correlations or dynamic sampling spaces. We show how the typical set is characterized from general forms of entropy and how one can transform these general entropic forms into extensive functionals and, in some cases, to Shannon path entropy. The definition of the typical set and generalized forms of entropy for systems with arbitrary phase space growth may help to provide an ensemble picture for the thermodynamic paths of many systems away from equilibrium. In particular, we argue that a theory of expanding/shrinking phase spaces in processes displaying an intrinsic degree of stochasticity may lead to new frameworks for exploring the emergence of complexity and robust properties in open ended evolutionary systems and, in particular, of biological systems.

READ FULL TEXT

page 1

page 2

page 5

research
02/10/2021

Differential Entropy Rate Characterisations of Long Range Dependent Processes

A quantity of interest to characterise continuous-valued stochastic proc...
research
01/07/2018

Shannon Information Entropy in Heavy-ion Collisions

The general idea of information entropy provided by C.E. Shannon "hangs ...
research
05/24/2021

NPD Entropy: A Non-Parametric Differential Entropy Rate Estimator

The estimation of entropy rates for stationary discrete-valued stochasti...
research
09/15/2020

A functorial characterization of von Neumann entropy

We classify the von Neumann entropy as a certain concave functor from fi...
research
07/13/2018

A combinatorial interpretation for Tsallis 2-entropy

While Shannon entropy is related to the growth rate of multinomial coeff...
research
12/05/2018

Evolution of k-mer Frequencies and Entropy in Duplication and Substitution Mutation Systems

Genomic evolution can be viewed as string-editing processes driven by mu...

Please sign up or login with your details

Forgot password? Click here to reset