On a 2-relative entropy

12/07/2021
by   James Fullwood, et al.
0

We construct a 2-categorical extension of the relative entropy functor of Baez and Fritz, and show that our construction is functorial with respect to vertical morphisms. Moreover, we show such a `2-relative entropy' satisfies natural 2-categorial analogues of convex linearity, vanishing under optimal hypotheses, and lower semicontinuity. While relative entropy is a relative measure of information between probability distributions, we view our construction as a relative measure of information between channels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2013

Relative Entropy, Probabilistic Inference and AI

Various properties of relative entropy have led to its widespread use in...
research
12/13/2017

A short characterization of relative entropy

We prove characterization theorems for relative entropy (also known as K...
research
12/30/2022

Relative Probability on Finite Outcome Spaces: A Systematic Examination of its Axiomatization, Properties, and Applications

This work proposes a view of probability as a relative measure rather th...
research
03/07/2017

Learning opacity in Stratal Maximum Entropy Grammar

Opaque phonological patterns are sometimes claimed to be difficult to le...
research
06/12/2023

Analysis of the Relative Entropy Asymmetry in the Regularization of Empirical Risk Minimization

The effect of the relative entropy asymmetry is analyzed in the empirica...
research
06/19/2020

Entropy and relative entropy from information-theoretic principles

We introduce an axiomatic approach to entropies and relative entropies t...

Please sign up or login with your details

Forgot password? Click here to reset