On the entropy of rectifiable and stratified measures

06/01/2023
by   Juan Pablo Vigneaux, et al.
0

We summarize some results of geometric measure theory concerning rectifiable sets and measures. Combined with the entropic chain rule for disintegrations (Vigneaux, 2021), they account for some properties of the entropy of rectifiable measures with respect to the Hausdorff measure first studied by (Koliander et al., 2016). Then we present some recent work on stratified measures, which are convex combinations of rectifiable measures. These generalize discrete-continuous mixtures and may have a singular continuous part. Their entropy obeys a chain rule, whose conditional term is an average of the entropies of the rectifiable measures involved. We state an asymptotic equipartition property (AEP) for stratified measures that shows concentration on strata of a few "typical dimensions" and that links the conditional term of the chain rule to the volume growth of typical sequences in each stratum.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2022

Typicality for stratified measures

Stratified measures on Euclidean space are defined here as convex combin...
research
02/18/2021

Entropy under disintegrations

We consider the differential entropy of probability measures absolutely ...
research
07/05/2021

The information loss of a stochastic map

We provide a stochastic extension of the Baez-Fritz-Leinster characteriz...
research
11/27/2022

Information Measures for Entropy and Symmetry

Entropy and information can be considered dual: entropy is a measure of ...
research
07/09/2021

Information cohomology of classical vector-valued observables

We provide here a novel algebraic characterization of two information me...
research
05/04/2023

Chain Rules for Renyi Information Combining

Bounds on information combining are a fundamental tool in coding theory,...
research
01/20/2022

An Information Theory Approach to Network Evolution Models

A novel Markovian network evolution model is introduced and analysed by ...

Please sign up or login with your details

Forgot password? Click here to reset