DeepAI AI Chat
Log In Sign Up

Real-Time Anomaly Detection for Advanced Manufacturing: Improving on Twitter's State of the Art

by   Caitríona M. Ryan, et al.
Maynooth University

The detection of anomalies in real time is paramount to maintain performance and efficiency across a wide range of applications including web services and smart manufacturing. This paper presents a novel algorithm to detect anomalies in streaming time series data via statistical learning. We adapt the generalised extreme studentised deviate test [1] to streaming data by using a sliding window approach. This is made computationally feasible by recursive updates of the Grubbs test statistic [2]. Moreover, a priority queue [3] is employed to reduce memory requirements, where subsets of the required data streaming window are maintained in the algorithm rather than the full list. Our method is statistically principled. It is suitable for streaming data and it outperforms the AnomalyDetection software package, recently released by Twitter Inc. (Twitter) [4] and used by multiple teams at Twitter as their state of the art on a daily basis [5]. The methodology is demonstrated using an example of unlabelled data from the Twitter AnomalyDetection GitHub repository and using a real manufacturing example with labelled anomalies.


page 1

page 2

page 3

page 4


Real-Time Anomaly Detection for Streaming Analytics

Much of the worlds data is streaming, time-series data, where anomalies ...

Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmark

Much of the world's data is streaming, time-series data, where anomalies...

Robust Projection based Anomaly Extraction (RPE) in Univariate Time-Series

This paper presents a novel, closed-form, and data/computation efficient...

An Efficient Anomaly Detection Approach using Cube Sampling with Streaming Data

Anomaly detection is critical in various fields, including intrusion det...

CNTS: Cooperative Network for Time Series

The use of deep learning techniques in detecting anomalies in time serie...

Active Anomaly Detection via Ensembles: Insights, Algorithms, and Interpretability

Anomaly detection (AD) task corresponds to identifying the true anomalie...

DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies

Extreme pricing anomalies may occur unexpectedly without a trivial cause...