RePAD: Real-time Proactive Anomaly Detection for Time Series

01/24/2020
by   Ming-Chang Lee, et al.
0

During the past decade, many anomaly detection approaches have been introduced in different fields such as network monitoring, fraud detection, and intrusion detection. However, they require understanding of data pattern and often need a long off-line period to build a model or network for the target data. Providing real-time and proactive anomaly detection for streaming time series without human intervention and domain knowledge is highly valuable since it greatly reduces human effort and enables appropriate countermeasures to be undertaken before a disastrous damage, failure, or other harmful event occurs. However, this issue has not been well studied yet. To address it, this paper proposes RePAD, which is a Real-time Proactive Anomaly Detection algorithm for streaming time series based on unsupervised Long Short-Term Memory (LSTM). RePAD utilizes short-term historic data points to predict and determine whether or not the upcoming data point is a sign that an anomaly is likely to happen in the near future. By dynamically adjusting the detection threshold over time, RePAD is able to tolerate minor pattern change in time series and detect anomalies either proactively or on time. Experiments based on two time series datasets collected from the Numenta Anomaly Benchmark demonstrate that RePAD is able to proactively detect anomalies and provide early warnings in real time without human intervention and domain knowledge.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2020

ReRe: A Lightweight Real-time Ready-to-Go Anomaly Detection Approach for Time Series

Anomaly detection is an active research topic in many different fields s...
research
11/30/2018

ADSaS: Comprehensive Real-time Anomaly Detection System

Since with massive data growth, the need for autonomous and generic anom...
research
03/08/2020

Hardware Architecture Proposal for TEDA algorithm to Data Streaming Anomaly Detection

The amount of data in real-time, such as time series and streaming data,...
research
02/13/2023

Unsupervised Detection of Behavioural Drifts with Dynamic Clustering and Trajectory Analysis

Real-time monitoring of human behaviours, especially in e-Health applica...
research
02/12/2021

How Far Should We Look Back to Achieve Effective Real-Time Time-Series Anomaly Detection?

Anomaly detection is the process of identifying unexpected events or ab-...
research
04/18/2017

Anomaly detection and motif discovery in symbolic representations of time series

The advent of the Big Data hype and the consistent recollection of event...
research
08/15/2023

Maat: Performance Metric Anomaly Anticipation for Cloud Services with Conditional Diffusion

Ensuring the reliability and user satisfaction of cloud services necessi...

Please sign up or login with your details

Forgot password? Click here to reset