Entropy as a Topological Operad Derivation

by   Tai-Danae Bradley, et al.

We share a small connection between information theory, algebra, and topology - namely, a correspondence between Shannon entropy and derivations of the operad of topological simplices. We begin with a brief review of operads and their representations with topological simplices and the real line as the main example. We then give a general definition for a derivation of an operad in any category with values in an abelian module over the operad. The main result is that Shannon entropy defines a derivation of the operad of topological simplices, and that for every derivation of this operad there exists a point at which it is given by a constant multiple of Shannon entropy. We show this is compatible with, and relies heavily on, a well-known characterization of entropy given by Faddeev in 1956 and a recent variation given by Leinster.


page 1

page 2

page 3

page 4


New identities for the Shannon function and applications

We show how the Shannon entropy function H(p,q)is expressible as a linea...

On the stability of persistent entropy and new summary functions for TDA

In this paper, we study properties of persistent entropy (the Shannon en...

Information entropy as an anthropomorphic concept

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic ...

Magnitude and topological entropy of digraphs

Magnitude and (co)weightings are quite general constructions in enriched...

Information entropy re-defined in a category theory context using preradicals

Algebraically, entropy can be defined for abelian groups and their endom...

Shannon's entropy and its Generalizations towards Statistics, Reliability and Information Science during 1948-2018

Starting from the pioneering works of Shannon and Weiner in 1948, a plet...

Complexity of Shift Spaces on Semigroups

Let G=〈 S|R_A〉 be a semigroup with generating set S and equivalences R...