RLAD: Time Series Anomaly Detection through Reinforcement Learning and Active Learning

by   Tong Wu, et al.

We introduce a new semi-supervised, time series anomaly detection algorithm that uses deep reinforcement learning (DRL) and active learning to efficiently learn and adapt to anomalies in real-world time series data. Our model - called RLAD - makes no assumption about the underlying mechanism that produces the observation sequence and continuously adapts the detection model based on experience with anomalous patterns. In addition, it requires no manual tuning of parameters and outperforms all state-of-art methods we compare with, both unsupervised and semi-supervised, across several figures of merit. More specifically, we outperform the best unsupervised approach by a factor of 1.58 on the F1 score, with only 1 real-world dataset with only 0.1 deep-learning based algorithms across two common anomaly detection datasets with up to around 3M data points and between 0.28 outperform all of them across several important performance metrics.



There are no comments yet.


page 1

page 2

page 3

page 4


Ymir: A Supervised Ensemble Framework for Multivariate Time Series Anomaly Detection

We proposed a multivariate time series anomaly detection frame-work Ymir...

Little Help Makes a Big Difference: Leveraging Active Learning to Improve Unsupervised Time Series Anomaly Detection

Key Performance Indicators (KPI), which are essentially time series data...

Semantic Discord: Finding Unusual Local Patterns for Time Series

Finding anomalous subsequence in a long time series is a very important ...

Active Reinforcement Learning – A Roadmap Towards Curious Classifier Systems for Self-Adaptation

Intelligent systems have the ability to improve their behaviour over tim...

Machine learning methods to detect money laundering in the Bitcoin blockchain in the presence of label scarcity

Every year, criminals launder billions of dollars acquired from serious ...

DeepFIB: Self-Imputation for Time Series Anomaly Detection

Time series (TS) anomaly detection (AD) plays an essential role in vario...

Anomaly Detection in Predictive Maintenance: A New Evaluation Framework for Temporal Unsupervised Anomaly Detection Algorithms

The research in anomaly detection lacks a unified definition of what rep...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.