DeepAI AI Chat
Log In Sign Up

Robust and efficient change point detection using novel multivariate rank-energy GoF test

by   Shoaib Bin Masud, et al.

In this paper, we use and further develop upon a recently proposed multivariate, distribution-free Goodness-of-Fit (GoF) test based on the theory of Optimal Transport (OT) called the Rank Energy (RE) [1], for non-parametric and unsupervised Change Point Detection (CPD) in multivariate time series data. We show that directly using RE leads to high sensitivity to very small changes in distributions (causing high false alarms) and it requires large sample complexity and huge computational cost. To alleviate these drawbacks, we propose a new GoF test statistic called as soft-Rank Energy (sRE) that is based on entropy regularized OT and employ it towards CPD. We discuss the advantages of using sRE over RE and demonstrate that the proposed sRE based CPD outperforms all the existing methods in terms of Area Under the Curve (AUC) and F1-score on real and synthetic data sets.


page 1

page 2

page 3

page 4


Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport

In this paper, we extend the recently proposed multivariate rank energy ...

On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection

This paper considers the use of recently proposed optimal transport-base...

Learning generative models for valid knockoffs using novel multivariate-rank based statistics

We consider the problem of generating valid knockoffs for knockoff filte...

Change point detection in low-rank VAR processes

Vector autoregressive (VAR) models are widely used in multivariate time ...

Unsupervised non-parametric change point detection in quasi-periodic signals

We propose a new unsupervised and non-parametric method to detect change...

Learning Latent Events from Network Message Logs: A Decomposition Based Approach

In this communication, we describe a novel technique for event mining us...

On Matched Filtering for Statistical Change Point Detection

Non-parametric and distribution-free two-sample tests have been the foun...