Cumulant-free closed-form formulas for some common (dis)similarities between densities of an exponential family

03/05/2020
by   Frank Nielsen, et al.
6

It is well-known that the Bhattacharyya, Hellinger, Kullback-Leibler, α-divergences, and Jeffreys' divergences between densities belonging to a same exponential family have generic closed-form formulas relying on the strictly convex and real-analytic cumulant function characterizing the exponential family. In this work, we report (dis)similarity formulas which bypass the explicit use of the cumulant function and highlight the role of quasi-arithmetic means and their multivariate mean operator extensions. In practice, these cumulant-free formulas are handy when implementing these (dis)similarities using legacy Application Programming Interfaces (APIs) since our method requires only to partially factorize the densities canonically of the considered exponential family.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2020

A note on Onicescu's informational energy and correlation coefficient in exponential families

The informational energy of Onicescu is a positive quantity that measure...
research
04/28/2021

The dually flat information geometry of the mixture family of two prescribed Cauchy components

In information geometry, a strictly convex and smooth function induces a...
research
07/01/2021

q-Paths: Generalizing the Geometric Annealing Path using Power Means

Many common machine learning methods involve the geometric annealing pat...
research
05/03/2021

Explicit formulas for the inverses of Toeplitz matrices, with applications

We derive explicit formulas for the inverses of truncated block Toeplitz...
research
04/22/2022

A note on the f-divergences between multivariate location-scale families with either prescribed scale matrices or location parameters

We first extend the result of Ali and Silvey [Journal of the Royal Stati...
research
09/19/2019

A note on the quasiconvex Jensen divergences and the quasiconvex Bregman divergences derived thereof

We first introduce the class of quasiconvex and quasiconcave Jensen dive...
research
01/14/2017

On Hölder projective divergences

We describe a framework to build distances by measuring the tightness of...

Please sign up or login with your details

Forgot password? Click here to reset