The fundamental thermodynamic costs of communication

02/08/2023
by   Farita Tasnim, et al.
0

In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple channels. A common hypothesis is that such inverse multiplexing strategies reduce total thermodynamic costs. So far, however, there have been no physics-based results supporting this hypothesis. This gap existed partially because we have lacked a theoretical framework that addresses the interplay of thermodynamics and information in off-equilibrium systems at any spatiotemporal scale. Here we present the first study that rigorously combines such a framework, stochastic thermodynamics, with Shannon information theory. We develop a minimal model that captures the fundamental features common to a wide variety of communication systems. We find that the thermodynamic cost in this model is a convex function of the channel capacity, the canonical measure of the communication capability of a channel. We also find that this function is not always monotonic, in contrast to previous results not derived from first principles physics. These results clarify when and how to split a single communication stream across multiple channels. In particular, we present Pareto fronts that reveal the trade-off between thermodynamic costs and channel capacity when inverse multiplexing. Due to the generality of our model, our findings could help explain empirical observations of how thermodynamic costs of information transmission make inverse multiplexing energetically favorable in many real-world communication systems.

READ FULL TEXT

page 2

page 6

research
01/06/2018

A Survey on Quantum Channel Capacities

Quantum information processing exploits the quantum nature of informatio...
research
03/18/2022

Carnot machine-based massive MIMO communication capacity modeling and performance analysis

Similar to the energy flowing process in traditional heat engines, infor...
research
12/23/2009

The use of ideas of Information Theory for studying "language" and intelligence in ants

In this review we integrate results of long term experimental study on a...
research
05/04/2023

Capacity Bounds for Vertically-Drifted First Arrival Position Channels under a Covariance Constraint

In this paper, we delve into the capacity problem of additive vertically...
research
01/10/2020

Two Applications of Deep Learning in the Physical Layer of Communication Systems

Deep learning has proved itself to be a powerful tool to develop data-dr...
research
03/26/2021

On the Semi-Decidability of Remote State Estimation and Stabilization via Noisy Communication Channels

We consider the task of remote state estimation and stabilization of dis...
research
02/16/2018

Information Theory: A Tutorial Introduction

Shannon's mathematical theory of communication defines fundamental limit...

Please sign up or login with your details

Forgot password? Click here to reset