The dually flat information geometry of the mixture family of two prescribed Cauchy components

04/28/2021
by   Frank Nielsen, et al.
0

In information geometry, a strictly convex and smooth function induces a dually flat Hessian manifold equipped with a pair of dual Bregman divergences, hereby termed a Bregman manifold. Two common types of such Bregman manifolds met in statistics are (1) the exponential family manifolds induced by the cumulant functions of regular exponential families, and (2) the mixture family manifolds induced by the Shannon negentropies of statistical mixture families with prescribed linearly independent mixture components. However, the differential entropy of a mixture of continuous probability densities sharing the same support is hitherto not known in closed form making implementation of mixture family manifolds in practice difficult. In this work, we report an exception: The family of mixtures of two prescribed and distinct Cauchy distributions. We exemplify the explicit construction of a dually flat manifold induced by the differential negentropy for this very particular setting. This construction allows one to use the geometric toolbox of Bregman algorithms, and to obtain closed-form formula (albeit being large) for the Kullback-Leibler divergence and the Jensen-Shannon divergence between two mixtures of two prescribed Cauchy components.

READ FULL TEXT

page 7

page 8

research
03/20/2018

Monte Carlo Information Geometry: The dually flat case

Exponential families and mixture families are parametric probability mod...
research
11/26/2022

Information Geometry of Dynamics on Graphs and Hypergraphs

We introduce a new information-geometric structure of dynamics on discre...
research
05/15/2023

Torification of Delzant polytope as dually flat space and its applications

In this paper we study dually flat spaces arising from Delzant polytopes...
research
03/05/2020

Cumulant-free closed-form formulas for some common (dis)similarities between densities of an exponential family

It is well-known that the Bhattacharyya, Hellinger, Kullback-Leibler, α-...
research
08/16/2018

Divergence functions in dually flat spaces and their properties

Dually flat spaces play a key role in the differential geometrical appro...
research
06/10/2021

Information Geometry of Reversible Markov Chains

We analyze the information geometric structure of time reversibility for...
research
05/08/2021

Projections with logarithmic divergences

In information geometry, generalized exponential families and statistica...

Please sign up or login with your details

Forgot password? Click here to reset