Hankel-structured Tensor Robust PCA for Multivariate Traffic Time Series Anomaly Detection

10/08/2021
by   Xudong Wang, et al.
5

Spatiotemporal traffic data (e.g., link speed/flow) collected from sensor networks can be organized as multivariate time series with additional spatial attributes. A crucial task in analyzing such data is to identify and detect anomalous observations and events from the data with complex spatial and temporal dependencies. Robust Principal Component Analysis (RPCA) is a widely used tool for anomaly detection. However, the traditional RPCA purely relies on the global low-rank assumption while ignoring the local temporal correlations. In light of this, this study proposes a Hankel-structured tensor version of RPCA for anomaly detection in spatiotemporal data. We treat the raw data with anomalies as a multivariate time series matrix (location × time) and assume the denoised matrix has a low-rank structure. Then we transform the low-rank matrix to a third-order tensor by applying temporal Hankelization. In the end, we decompose the corrupted matrix into a low-rank Hankel tensor and a sparse matrix. With the Hankelization operation, the model can simultaneously capture the global and local spatiotemporal correlations and exhibit more robust performance. We formulate the problem as an optimization problem and use tensor nuclear norm (TNN) to approximate the tensor rank and l_1 norm to approximate the sparsity. We develop an efficient solution algorithm based on the Alternating Direction Method of Multipliers (ADMM). Despite having three hyper-parameters, the model is easy to set in practice. We evaluate the proposed method by synthetic data and metro passenger flow time series and the results demonstrate the accuracy of anomaly detection.

READ FULL TEXT

page 1

page 2

page 4

page 7

page 9

research
05/21/2021

Low-Rank Hankel Tensor Completion for Traffic Speed Estimation

This paper studies the traffic state estimation (TSE) problem using spar...
research
08/03/2022

Robust PCA for Anomaly Detection and Data Imputation in Seasonal Time Series

We propose a robust principal component analysis (RPCA) framework to rec...
research
10/23/2020

Low-rank on Graphs plus Temporally Smooth Sparse Decomposition for Anomaly Detection in Spatiotemporal Data

Anomaly detection in spatiotemporal data is a challenging problem encoun...
research
05/10/2020

Non-recurrent Traffic Congestion Detection with a Coupled Scalable Bayesian Robust Tensor Factorization Model

Non-recurrent traffic congestion (NRTC) usually brings unexpected delays...
research
05/30/2017

Tracking System Behaviour from Resource Usage Data

Resource usage data, collected using tools such as TACC Stats, capture t...
research
08/19/2016

Network Volume Anomaly Detection and Identification in Large-scale Networks based on Online Time-structured Traffic Tensor Tracking

This paper addresses network anomography, that is, the problem of inferr...
research
04/05/2020

Routine pattern discovery and anomaly detection in individual travel behavior

Discovering patterns and detecting anomalies in individual travel behavi...

Please sign up or login with your details

Forgot password? Click here to reset