Nonparametric and Online Change Detection in Multivariate Datastreams using QuantTree

08/30/2022
by   Luca Frittoli, et al.
0

We address the problem of online change detection in multivariate datastreams, and we introduce QuantTree Exponentially Weighted Moving Average (QT-EWMA), a nonparametric change-detection algorithm that can control the expected time before a false alarm, yielding a desired Average Run Length (ARL_0). Controlling false alarms is crucial in many applications and is rarely guaranteed by online change-detection algorithms that can monitor multivariate datastreams without knowing the data distribution. Like many change-detection algorithms, QT-EWMA builds a model of the data distribution, in our case a QuantTree histogram, from a stationary training set. To monitor datastreams even when the training set is extremely small, we propose QT-EWMA-update, which incrementally updates the QuantTree histogram during monitoring, always keeping the ARL_0 under control. Our experiments, performed on synthetic and real-world datastreams, demonstrate that QT-EWMA and QT-EWMA-update control the ARL_0 and the false alarm rate better than state-of-the-art methods operating in similar conditions, achieving lower or comparable detection delays.

READ FULL TEXT
research
10/16/2022

Class Distribution Monitoring for Concept Drift Detection

We introduce Class Distribution Monitoring (CDM), an effective concept-d...
research
05/30/2022

Profile Monitoring via Eigenvector Perturbation

Control charts are often used to monitor the quality characteristics of ...
research
01/11/2021

Controlling the EWMA S^2 control chart false alarm behavior when the in-control variance level must be estimated

Investigating the problem of setting control limits in the case of param...
research
06/27/2021

Score-Based Change Detection for Gradient-Based Learning Machines

The widespread use of machine learning algorithms calls for automatic ch...
research
01/26/2022

Online Change Point Detection for Weighted and Directed Random Dot Product Graphs

Given a sequence of random (directed and weighted) graphs, we address th...
research
11/02/2021

Inference in high-dimensional online changepoint detection

We introduce and study two new inferential challenges associated with th...
research
12/24/2021

Monitoring Deforestation Using Multivariate Bayesian Online Changepoint Detection with Outliers

Near real time change detection is important for a variety of Earth moni...

Please sign up or login with your details

Forgot password? Click here to reset