DeepAI
Log In Sign Up

Local Two-Sample Testing over Graphs and Point-Clouds by Random-Walk Distributions

11/06/2020
by   Boris Landa, et al.
0

Two-sample testing is a fundamental tool for scientific discovery. Yet, aside from concluding that two samples do not come from the same probability distribution, it is often of interest to characterize how the two distributions differ. Specifically, given samples from two densities f_1 and f_0, we consider the problem of localizing occurrences of the inequality f_1 > f_0 in the combined sample. We present a general hypothesis testing framework for this task, and investigate a special case of this framework where localization is achieved by a random walk over the sample. We derive a tractable testing procedure for this case employing a type of scan statistic, and provide non-asymptotic lower bounds on the power and accuracy of our test to detect whether f_1>f_0 in a local sense. We also characterize the test's consistency according to a certain problem-hardness parameter, and show that our test achieves the minimax rate for this parameter. We conduct numerical experiments to validate our method, and demonstrate our approach on two real-world applications: detecting and localizing arsenic well contamination across the United States, and analyzing two-sample single-cell RNA sequencing data from melanoma patients.

READ FULL TEXT
05/17/2017

Two-Sample Tests for Large Random Graphs Using Network Statistics

We consider a two-sample hypothesis testing problem, where the distribut...
11/02/2022

Likelihood-free hypothesis testing

Consider the problem of testing Z ∼ℙ^⊗ m vs Z ∼ℚ^⊗ m from m samples. Gen...
02/01/2019

Local minimax rates for closeness testing of discrete distributions

We consider the closeness testing (or two-sample testing) problem in the...
08/30/2018

Maximum likelihood estimator and its consistency for an (L,1) random walk in a parametric random environment

Consider an (L,1) random walk in an i.i.d. random environment, whose env...
11/06/2019

Minimax Nonparametric Two-sample Test

We consider the problem of comparing probability densities between two g...
07/03/2020

Two-sample Testing for Large, Sparse High-Dimensional Multinomials under Rare/Weak Perturbations

Given two samples from possibly different discrete distributions over a ...
10/15/2012

The Perturbed Variation

We introduce a new discrepancy score between two distributions that give...