Uncertainty relations and fluctuation theorems for Bayes nets

11/07/2019
by   David H. Wolpert, et al.
17

The pioneering paper [Ito and Sagawa, 2013] analyzed the non-equilibrium statistical physics of a set of multiple interacting systems, S, whose joint discrete-time evolution is specified by a Bayesian network. The major result of [Ito and Sagawa, 2013] was an integral fluctuation theorem (IFT) governing the sum of two quantities: the entropy production (EP) of an arbitrary single v in S, and the transfer entropy from v to the other systems. Here I extend the analysis in [Ito and Sagawa, 2013]. I derive several detailed fluctuation theorems (DFTs), concerning arbitrary subsets of all the systems (including the full set). I also derive several associated IFTs, concerning an arbitrary subset of the systems, thereby extending the IFT in [Ito and Sagawa, 2013]. In addition I derive "conditional" DFTs and IFTs, involving conditional probability distributions rather than (as in conventional fluctuation theorems) unconditioned distributions. I then derive thermodynamic uncertainty relations relating the total EP of the Bayes net to the set of all the precisions of probability currents within the individual systems. I end with an example of that uncertainty relation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/18/2022

Thermodynamic-kinetic uncertainty relation: properties and an information-theoretic interpretation

Universal relations that characterize the fluctuations of nonequilibrium...
research
05/04/2019

Projection Theorems, Estimating Equations, and Power-Law Distributions

Projection theorems of divergence functionals reduce certain estimation ...
research
01/07/2020

Minimum entropy production in multipartite processes due to neighborhood constraints

It is known that the minimal total entropy production (EP) generated dur...
research
06/27/2019

Harnessing Fluctuations in Thermodynamic Computing via Time-Reversal Symmetries

We experimentally demonstrate that highly structured distributions of wo...
research
09/30/2020

Uncertainty Reasoning for Probabilistic Petri Nets via Bayesian Networks

This paper exploits extended Bayesian networks for uncertainty reasoning...
research
06/06/2023

Machine learning in and out of equilibrium

The algorithms used to train neural networks, like stochastic gradient d...
research
05/27/2011

A Counter Example to Theorems of Cox and Fine

Cox's well-known theorem justifying the use of probability is shown not ...

Please sign up or login with your details

Forgot password? Click here to reset