Information cohomology of classical vector-valued observables

07/09/2021
by   Juan Pablo Vigneaux, et al.
0

We provide here a novel algebraic characterization of two information measures associated with a vector-valued random variable, its differential entropy and the dimension of the underlying space, purely based on their recursive properties (the chain rule and the nullity-rank theorem, respectively). More precisely, we compute the information cohomology of Baudot and Bennequin with coefficients in a module of continuous probabilistic functionals over a category that mixes discrete observables and continuous vector-valued observables, characterizing completely the 1-cocycles; evaluated on continuous laws, these cocycles are linear combinations of the differential entropy and the dimension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2021

Variations on a Theme by Massey

In 1994, James Lee Massey proposed the guessing entropy as a measure of ...
research
12/21/2022

Typicality for stratified measures

Stratified measures on Euclidean space are defined here as convex combin...
research
02/09/2022

Towards Empirical Process Theory for Vector-Valued Functions: Metric Entropy of Smooth Function Classes

This paper provides some first steps in developing empirical process the...
research
06/18/2017

Entropy, neutro-entropy and anti-entropy for neutrosophic information

This approach presents a multi-valued representation of the neutrosophic...
research
03/04/2020

A homological characterization of generalized multinomial coefficients related to the entropic chain rule

There is an asymptotic relationship between the multiplicative relations...
research
06/01/2023

On the entropy of rectifiable and stratified measures

We summarize some results of geometric measure theory concerning rectifi...
research
01/04/2021

The Gaussian entropy map in valued fields

We exhibit the analog of the entropy map for multivariate Gaussian distr...

Please sign up or login with your details

Forgot password? Click here to reset