Detection of Sparse Mixtures: Higher Criticism and Scan Statistic

02/23/2018
by   Ery Arias-Castro, et al.
0

We consider the problem of detecting a sparse mixture as studied by Ingster (1997) and Donoho and Jin (2004). We consider a wide array of base distributions. In particular, we study the situation when the base distribution has polynomial tails, a situation that has not received much attention in the literature. Perhaps surprisingly, we find that in the context of such a power-law distribution, the higher criticism does not achieve the detection boundary. However, the scan statistic does.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/26/2017

An expectation-based space-time scan statistic for ZIP-distributed data

An expectation-based scan statistic is proposed for the prospective moni...
research
11/17/2018

Detection of Sparse Positive Dependence

In a bivariate setting, we consider the problem of detecting a sparse co...
research
08/13/2020

Calibrating the scan statistic: finite sample performance vs. asymptotics

We consider the problem of detecting an elevated mean on an interval wit...
research
04/06/2021

Statistical Limits of Sparse Mixture Detection

We consider the problem of detecting a general sparse mixture and obtain...
research
11/26/2020

Detecting Sparse Heterogeneous Mixtures in a Two-Sample Problem

We consider the problem of detecting sparse heterogeneous mixtures in a ...
research
10/04/2019

On the Asymptotic Distribution of the Scan Statistic for Point Clouds

We derive the large-sample distribution of several variants of the scan ...
research
02/16/2018

Learning Patterns for Detection with Multiscale Scan Statistics

This paper addresses detecting anomalous patterns in images, time-series...

Please sign up or login with your details

Forgot password? Click here to reset