TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data

01/18/2022
by   Shreshth Tuli, et al.
0

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a challenging problem. This is due to the lack of anomaly labels, high data volatility and the demands of ultra-low inference times in modern applications. Despite the recent developments of deep learning approaches for anomaly detection, only a few of them can address all of these challenges. In this paper, we propose TranAD, a deep transformer network based anomaly detection and diagnosis model which uses attention-based sequence encoders to swiftly perform inference with the knowledge of the broader temporal trends in the data. TranAD uses focus score-based self-conditioning to enable robust multi-modal feature extraction and adversarial training to gain stability. Additionally, model-agnostic meta learning (MAML) allows us to train the model using limited data. Extensive empirical studies on six publicly available datasets demonstrate that TranAD can outperform state-of-the-art baseline methods in detection and diagnosis performance with data and time-efficient training. Specifically, TranAD increases F1 scores by up to 17 training times by up to 99

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2018

A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data

Nowadays, multivariate time series data are increasingly collected in va...
research
06/11/2021

HIFI: Anomaly Detection for Multivariate Time Series with High-order Feature Interactions

Monitoring complex systems results in massive multivariate time series d...
research
09/23/2021

An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series

Several techniques for multivariate time series anomaly detection have b...
research
03/10/2022

TiSAT: Time Series Anomaly Transformer

While anomaly detection in time series has been an active area of resear...
research
11/01/2019

THAAD: Efficient Matching Queries under Temporal Abstraction for Anomaly Detection

In this paper we present a novel algorithm and efficient data structure ...
research
01/03/2023

Unsupervised Multivariate Time-Series Transformers for Seizure Identification on EEG

Epilepsy is one of the most common neurological disorders, typically obs...

Please sign up or login with your details

Forgot password? Click here to reset