Entropy as a Topological Operad Derivation

07/20/2021
by   Tai-Danae Bradley, et al.
0

We share a small connection between information theory, algebra, and topology - namely, a correspondence between Shannon entropy and derivations of the operad of topological simplices. We begin with a brief review of operads and their representations with topological simplices and the real line as the main example. We then give a general definition for a derivation of an operad in any category with values in an abelian module over the operad. The main result is that Shannon entropy defines a derivation of the operad of topological simplices, and that for every derivation of this operad there exists a point at which it is given by a constant multiple of Shannon entropy. We show this is compatible with, and relies heavily on, a well-known characterization of entropy given by Faddeev in 1956 and a recent variation given by Leinster.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/25/2021

New identities for the Shannon function and applications

We show how the Shannon entropy function H(p,q)is expressible as a linea...
03/22/2018

On the stability of persistent entropy and new summary functions for TDA

In this paper, we study properties of persistent entropy (the Shannon en...
03/06/2015

Information entropy as an anthropomorphic concept

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic ...
05/10/2022

Magnitude and topological entropy of digraphs

Magnitude and (co)weightings are quite general constructions in enriched...
12/11/2021

Information entropy re-defined in a category theory context using preradicals

Algebraically, entropy can be defined for abelian groups and their endom...
01/28/2019

Shannon's entropy and its Generalizations towards Statistics, Reliability and Information Science during 1948-2018

Starting from the pioneering works of Shannon and Weiner in 1948, a plet...
08/14/2018

Complexity of Shift Spaces on Semigroups

Let G=〈 S|R_A〉 be a semigroup with generating set S and equivalences R...