Distances between probability distributions of different dimensions

11/01/2020
by   Yuhang Cai, et al.
0

Comparing probability distributions is an indispensable and ubiquitous task in machine learning and statistics. The most common way to compare a pair of Borel probability measures is to compute a metric between them, and by far the most widely used notions of metric are the Wasserstein metric and the total variation metric. The next most common way is to compute a divergence between them, and in this case almost every known divergences such as those of Kullback-Leibler, Jensen-Shannon, Rényi, and many more, are special cases of the f-divergence. Nevertheless these metrics and divergences may only be computed, in fact, are only defined, when the pair of probability measures are on spaces of the same dimension. How would one measure, say, a Wasserstein distance between the uniform distribution on the interval [-1,1] and a Gaussian distribution on ℝ^3? We will show that various common notions of metrics and divergences can be extended in a completely natural manner to Borel probability measures defined on spaces of different dimensions, e.g., one on ℝ^m and another on ℝ^n where m, n are distinct, so as to give a meaningful answer to the previous question.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/06/2023

Probability Metrics for Tropical Spaces of Different Dimensions

The problem of comparing probability distributions is at the heart of ma...
research
10/28/2019

Adaptive Sampling for Estimating Multiple Probability Distributions

We consider the problem of allocating samples to a finite set of discret...
research
01/12/2016

A metric for sets of trajectories that is practical and mathematically consistent

Metrics on the space of sets of trajectories are important for scientist...
research
09/05/2023

Hyperbolic contractivity and the Hilbert metric on probability measures

This paper gives a self-contained introduction to the Hilbert projective...
research
11/27/2017

Distances between States and between Predicates

This paper gives a systematic account of various metrics on probability ...
research
08/30/2020

Probability-turbulence divergence: A tunable allotaxonometric instrument for comparing heavy-tailed categorical distributions

Real-world complex systems often comprise many distinct types of element...
research
01/08/2017

A Framework for Wasserstein-1-Type Metrics

We propose a unifying framework for generalising the Wasserstein-1 metri...

Please sign up or login with your details

Forgot password? Click here to reset