Minimum entropy production in multipartite processes due to neighborhood constraints

01/07/2020
by   David H. Wolpert, et al.
0

It is known that the minimal total entropy production (EP) generated during the discrete-time evolution of a composite system is nonzero if its subsystems are isolated from one another. Minimal EP is also nonzero if the subsystems jointly implement a specified Bayes net. Here I extend these discrete-time results to continuous time, and to allow all subsystems to be simultaneously interacting. To do this I model the composite system as a multipartite process, subject to constraints on the overlaps among the "neighborhoods" of the rate matrices of the subsystems. I derive two information-theoretic lower bounds on the minimal achievable EP rate expressed in terms of those neighborhood overlaps. The first bound is based on applying the inclusion-exclusion principle to the eighborhood overlaps. The second is based on constructing counterfactual rate matrices, in which all subsystems outside of a particular neighborhood are held fixed while those inside the neighborhood are allowed to evolve. This second bound involves quantities related to the "learning rate" of stationary bipartite systems, or more generally to the "information flow".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2016

Information-Theoretic Lower Bounds for Recovery of Diffusion Network Structures

We study the information-theoretic lower bound of the sample complexity ...
research
03/09/2021

The state dependence of integrated, instantaneous, and fluctuating entropy production in quantum and classical processes

Given a fixed physical process, we consider the entropy production (EP) ...
research
11/07/2019

Uncertainty relations and fluctuation theorems for Bayes nets

The pioneering paper [Ito and Sagawa, 2013] analyzed the non-equilibrium...
research
04/18/2023

An Information-Theoretic Analysis of Discrete-Time Control and Filtering Limitations by the I-MMSE Relationships

Fundamental limitations or performance trade-offs/limits are important p...
research
04/09/2018

Characterising information-theoretic storage and transfer in continuous time processes

The characterisation of information processing is an important task in c...
research
10/17/2020

Continuum limit of p-Laplacian evolution problems on graphs:L^q graphons and sparse graphs

In this paper we study continuum limits of the discretized p-Laplacian e...
research
07/18/2022

Thermodynamic-kinetic uncertainty relation: properties and an information-theoretic interpretation

Universal relations that characterize the fluctuations of nonequilibrium...

Please sign up or login with your details

Forgot password? Click here to reset