Multivariate Time-Series Anomaly Detection with Contaminated Data: Application to Physiological Signals

08/24/2023
by   Thi Kieu Khanh Ho, et al.
0

Mainstream unsupervised anomaly detection algorithms often excel in academic datasets, yet their real-world performance is restricted due to the controlled experimental conditions involving clean training data. Addressing the challenge of training with noise, a prevalent issue in practical anomaly detection, is frequently overlooked. In a pioneering endeavor, this study delves into the realm of label-level noise within sensory time-series anomaly detection (TSAD). This paper presents a novel and practical end-to-end unsupervised TSAD when the training data are contaminated with anomalies. The introduced approach, called TSAD-C, is devoid of access to abnormality labels during the training phase. TSAD-C encompasses three modules: a Decontaminator to rectify the abnormalities (aka noise) present in the training data, a Variable Dependency Modeling module to capture both long-term intra- and inter-variable dependencies within the decontaminated data that can be considered as a surrogate of the pure normal data, and an Anomaly Scoring module to detect anomalies. Our extensive experiments conducted on three widely used physiological datasets conclusively demonstrate that our approach surpasses existing methodologies, thus establishing a new state-of-the-art performance in the field.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2020

Reconstruct Anomaly to Normal: Adversarial Learned and Latent Vector-constrained Autoencoder for Time-series Anomaly Detection

Anomaly detection in time series has been widely researched and has impo...
research
06/27/2023

Precursor-of-Anomaly Detection for Irregular Time Series

Anomaly detection is an important field that aims to identify unexpected...
research
08/03/2022

Robust Learning of Deep Time Series Anomaly Detection Models with Contaminated Training Data

Time series anomaly detection (TSAD) is an important data mining task wi...
research
01/13/2022

Forecast-based Multi-aspect Framework for Multivariate Time-series Anomaly Detection

Today's cyber-world is vastly multivariate. Metrics collected at extreme...
research
05/14/2023

A Dataset Fusion Algorithm for Generalised Anomaly Detection in Homogeneous Periodic Time Series Datasets

The generalisation of Neural Networks (NN) to multiple datasets is often...
research
08/25/2023

A Generic Machine Learning Framework for Fully-Unsupervised Anomaly Detection with Contaminated Data

Anomaly detection (AD) tasks have been solved using machine learning alg...
research
04/06/2023

From Explanation to Action: An End-to-End Human-in-the-loop Framework for Anomaly Reasoning and Management

Anomalies are often indicators of malfunction or inefficiency in various...

Please sign up or login with your details

Forgot password? Click here to reset