A Unifying Framework for Some Directed Distances in Statistics

03/02/2022
by   Michel Broniatowski, et al.
0

Density-based directed distances – particularly known as divergences – between probability distributions are widely used in statistics as well as in the adjacent research fields of information theory, artificial intelligence and machine learning. Prominent examples are the Kullback-Leibler information distance (relative entropy) which e.g. is closely connected to the omnipresent maximum likelihood estimation method, and Pearson's chisquare-distance which e.g. is used for the celebrated chisquare goodness-of-fit test. Another line of statistical inference is built upon distribution-function-based divergences such as e.g. the prominent (weighted versions of) Cramer-von Mises test statistics respectively Anderson-Darling test statistics which are frequently applied for goodness-of-fit investigations; some more recent methods deal with (other kinds of) cumulative paired divergences and closely related concepts. In this paper, we provide a general framework which covers in particular both the above-mentioned density-based and distribution-function-based divergence approaches; the dissimilarity of quantiles respectively of other statistical functionals will be included as well. From this framework, we structurally extract numerous classical and also state-of-the-art (including new) procedures. Furthermore, we deduce new concepts of dependence between random variables, as alternatives to the celebrated mutual information. Some variational representations are discussed, too.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2021

A precise bare simulation approach to the minimization of some distances. Foundations

In information theory – as well as in the adjacent fields of statistics,...
research
11/21/2022

Limit distribution theory for f-Divergences

f-divergences, which quantify discrepancy between probability distributi...
research
09/20/2018

New L^2-type exponentiality tests

We introduce new consistent and scale-free goodness-of-fit tests for the...
research
11/18/2022

Testing for the Pareto type I distribution: A comparative study

Pareto distributions are widely used models in economics, finance and ac...
research
06/01/2021

Statistical tests based on Rényi entropy estimation

Entropy and its various generalizations are important in many fields, in...
research
10/21/2020

The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

We introduce some new classes of unimodal rotational invariant direction...
research
01/13/2023

Privatitation of Probability Distributions by use Wavelet Integral approach

A naive theory of additive perturbations on a continuous probability dis...

Please sign up or login with your details

Forgot password? Click here to reset