Collective anomaly detection in High-dimensional VAR Models

05/16/2021
by   Hyeyoung Maeng, et al.
0

There is increasing interest in detecting collective anomalies: potentially short periods of time where the features of data change before reverting back to normal behaviour. We propose a new method for detecting a collective anomaly in VAR models. Our focus is on situations where the change in the VAR coefficient matrix at an anomaly is sparse, i.e. a small number of entries of the VAR coefficient matrix change. To tackle this problem, we propose a test statistic for a local segment that is built on the lasso estimator of the change in model parameters. This enables us to detect a sparse change more efficiently and our lasso-based approach becomes especially advantageous when the anomalous interval is short. We show that the new procedure controls Type 1 error and has asymptotic power tending to one. The practicality of our approach is demonstrated through simulations and two data examples, involving New York taxi trip data and EEG data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2019

Subset Multivariate Collective And Point Anomaly Detection

In recent years, there has been a growing interest in identifying anomal...
research
01/31/2018

One-class Collective Anomaly Detection based on Long Short-Term Memory Recurrent Neural Networks

Intrusion detection for computer network systems has been becoming one o...
research
06/05/2018

A linear time method for the detection of point and collective anomalies

The challenge of efficiently identifying anomalies in data sequences is ...
research
07/02/2021

A Collective Anomaly Detection Method Over Bitcoin Network

The popularity and amazing attractiveness of cryptocurrencies, and espec...
research
08/11/2017

Time Series Anomaly Detection; Detection of anomalous drops with limited features and sparse examples in noisy highly periodic data

Google uses continuous streams of data from industry partners in order t...
research
07/02/2022

Multivariate Time Series Anomaly Detection with Few Positive Samples

Given the scarcity of anomalies in real-world applications, the majority...
research
09/02/2008

From Data to the p-Adic or Ultrametric Model

We model anomaly and change in data by embedding the data in an ultramet...

Please sign up or login with your details

Forgot password? Click here to reset