The Perturbed Variation

10/15/2012
by   Maayan Harel, et al.
0

We introduce a new discrepancy score between two distributions that gives an indication on their similarity. While much research has been done to determine if two samples come from exactly the same distribution, much less research considered the problem of determining if two finite samples come from similar distributions. The new score gives an intuitive interpretation of similarity; it optimally perturbs the distributions so that they best fit each other. The score is defined between distributions, and can be efficiently estimated from samples. We provide convergence bounds of the estimated score, and develop hypothesis testing procedures that test if two data sets come from similar distributions. The statistical power of this procedures is presented in simulations. We also compare the score's capacity to detect similarity with that of other known measures on real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2023

Independent additive weighted bias distributions and associated goodness-of-fit tests

We use a Stein identity to define a new class of parametric distribution...
research
05/02/2013

Testing Hypotheses by Regularized Maximum Mean Discrepancy

Do two data samples come from different distributions? Recent studies of...
research
10/18/2021

The f-divergence and Loss Functions in ROC Curve

Given two data distributions and a test score function, the Receiver Ope...
research
06/09/2021

Statistical Classification via Robust Hypothesis Testing

In this letter, we consider multiple statistical classification problem ...
research
03/02/2023

A critical review of existing and new population stability testing procedures in credit risk scoring

Credit scorecards are models used for the modelling of the probability o...
research
04/09/2019

Kernelized Complete Conditional Stein Discrepancy

Much of machine learning relies on comparing distributions with discrepa...
research
08/17/2023

Kernel-Based Tests for Likelihood-Free Hypothesis Testing

Given n observations from two balanced classes, consider the task of lab...

Please sign up or login with your details

Forgot password? Click here to reset