Online Change Point Detection for Weighted and Directed Random Dot Product Graphs

01/26/2022
by   Bernardo Marenco, et al.
0

Given a sequence of random (directed and weighted) graphs, we address the problem of online monitoring and detection of changes in the underlying data distribution. Our idea is to endow sequential change-point detection (CPD) techniques with a graph representation learning substrate based on the versatile Random Dot Product Graph (RDPG) model. We consider efficient, online updates of a judicious monitoring function, which quantifies the discrepancy between the streaming graph observations and the nominal RDPG. This reference distribution is inferred via spectral embeddings of the first few graphs in the sequence. We characterize the distribution of this running statistic to select thresholds that guarantee error-rate control, and under simplifying approximations we offer insights on the algorithm's detection resolution and delay. The end result is a lightweight online CPD algorithm, that is also explainable by virtue of the well-appreciated interpretability of RDPG embeddings. This is in stark contrast with most existing graph CPD approaches, which either rely on extensive computation, or they store and process the entire observed time series. An apparent limitation of the RDPG model is its suitability for undirected and unweighted graphs only, a gap we aim to close here to broaden the scope of the CPD framework. Unlike previous proposals, our non-parametric RDPG model for weighted graphs does not require a priori specification of the weights' distribution to perform inference and estimation. This network modeling contribution is of independent interest beyond CPD. We offer an open-source implementation of the novel online CPD algorithm for weighted and direct graphs, whose effectiveness and efficiency are demonstrated via (reproducible) synthetic and real network data experiments.

READ FULL TEXT
research
02/11/2021

Optimality of Graph Scanning Statistic for Online Community Detection

Sequential change-point detection for graphs is a fundamental problem fo...
research
03/29/2022

Graph similarity learning for change-point detection in dynamic networks

Dynamic networks are ubiquitous for modelling sequential graph-structure...
research
06/21/2022

A Contrastive Approach to Online Change Point Detection

We suggest a novel procedure for online change point detection. Our appr...
research
05/21/2018

NEWMA: a new method for scalable model-free online change-point detection

We consider the problem of detecting abrupt changes in the distribution ...
research
06/27/2023

Multilayer random dot product graphs: Estimation and online change point detection

We study the multilayer random dot product graph (MRDPG) model, an exten...
research
08/30/2022

Nonparametric and Online Change Detection in Multivariate Datastreams using QuantTree

We address the problem of online change detection in multivariate datast...
research
11/04/2021

Robust Online Detection in Serially Correlated Directed Network

As the complexity of production processes increases, the diversity of da...

Please sign up or login with your details

Forgot password? Click here to reset