E-detectors: a nonparametric framework for online changepoint detection

03/07/2022
by   Jaehyeok Shin, et al.
0

Sequential changepoint detection is a classical problem with a variety of applications. However, the majority of prior work has been parametric, for example, focusing on exponential families. We develop a fundamentally new and general framework for changepoint detection when the pre- and post-change distributions are nonparametrically specified (and thus composite). Our procedures come with clean, nonasymptotic bounds on the average run length (frequency of false alarms). In certain nonparametric cases (like sub-Gaussian or sub-exponential), we also provide near-optimal bounds on the detection delay following a changepoint. The primary technical tool that we introduce is called an e-detector, which is composed of sums of e-processes – a fundamental generalization of nonnegative supermartingales – that are started at consecutive times. We first introduce simple Shiryaev-Roberts and CUSUM-style e-detectors, and then show how to design their mixtures in order to achieve both statistical and computational efficiency. We demonstrate their efficacy in detecting changes in the mean of a bounded random variable without any i.i.d. assumptions, with an application to tracking the performance of a sports team over multiple seasons.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2023

Reducing sequential change detection to sequential estimation

We consider the problem of sequential change detection, where the goal i...
research
09/07/2021

On the CUSUM procedure for phase-type distributions: a Lévy fluctuation theory approach

We introduce a new method analyzing the cumulative sum (CUSUM) procedure...
research
07/24/2018

Asymptotic Optimality of Mixture Rules for Detecting Changes in General Stochastic Models

The paper addresses a sequential changepoint detection problem for a gen...
research
06/03/2020

Conformal e-prediction for change detection

We adapt conformal e-prediction to change detection, defining analogues ...
research
09/18/2020

Sequential changepoint detection for label shift in classification

Classifier predictions often rely on the assumption that new observation...
research
02/02/2022

Robust Estimation for Nonparametric Families via Generative Adversarial Networks

We provide a general framework for designing Generative Adversarial Netw...
research
07/28/2021

On Optimal Quantization in Sequential Detection

The problem of designing optimal quantization rules for sequential detec...

Please sign up or login with your details

Forgot password? Click here to reset