Bregman divergences based on optimal design criteria and simplicial measures of dispersion

09/05/2018
by   Luc Pronzato, et al.
0

In previous work the authors defined the k-th order simplicial distance between probability distributions which arises naturally from a measure of dispersion based on the squared volume of random simplices of dimension k. This theory is embedded in the wider theory of divergences and distances between distributions which includes Kullback-Leibler, Jensen-Shannon, Jeffreys-Bregman divergence and Bhattacharyya distance. A general construction is given based on defining a directional derivative of a function ϕ from one distribution to the other whose concavity or strict concavity influences the properties of the resulting divergence. For the normal distribution these divergences can be expressed as matrix formula for the (multivariate) means and covariances. Optimal experimental design criteria contribute a range of functionals applied to non-negative, or positive definite, information matrices. Not all can distinguish normal distributions but sufficient conditions are given. The k-th order simplicial distance is revisited from this aspect and the results are used to test empirically the identity of means and covariances.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/30/2021

On the Kullback-Leibler divergence between discrete normal distributions

Discrete normal distributions are defined as the distributions with pres...
research
01/29/2021

On f-divergences between Cauchy distributions

We prove that the f-divergences between univariate Cauchy distributions ...
research
10/28/2008

A non-negative expansion for small Jensen-Shannon Divergences

In this report, we derive a non-negative series expansion for the Jensen...
research
02/16/2023

A numerical approximation method for the Fisher-Rao distance between multivariate normal distributions

We present a simple method to approximate Rao's distance between multiva...
research
10/26/2020

A Tight Lower Bound for the Hellinger Distance with Given Means and Variances

The binary divergences that are divergences between probability measures...
research
04/02/2020

Sequential online subsampling for thinning experimental designs

We consider a design problem where experimental conditions (design point...
research
10/28/2019

Adaptive Sampling for Estimating Multiple Probability Distributions

We consider the problem of allocating samples to a finite set of discret...

Please sign up or login with your details

Forgot password? Click here to reset