Deep Anomaly Detection and Search via Reinforcement Learning

by   Chao Chen, et al.
Nanjing University
Alibaba Group

Semi-supervised Anomaly Detection (AD) is a kind of data mining task which aims at learning features from partially-labeled datasets to help detect outliers. In this paper, we classify existing semi-supervised AD methods into two categories: unsupervised-based and supervised-based, and point out that most of them suffer from insufficient exploitation of labeled data and under-exploration of unlabeled data. To tackle these problems, we propose Deep Anomaly Detection and Search (DADS), which applies Reinforcement Learning (RL) to balance exploitation and exploration. During the training process, the agent searches for possible anomalies with hierarchically-structured datasets and uses the searched anomalies to enhance performance, which in essence draws lessons from the idea of ensemble learning. Experimentally, we compare DADS with several state-of-the-art methods in the settings of leveraging labeled known anomalies to detect both other known anomalies and unknown anomalies. Results show that DADS can efficiently and precisely search anomalies from unlabeled data and learn from them, thus achieving good performance.


page 1

page 2

page 3

page 4


SPADE: Semi-supervised Anomaly Detection under Distribution Mismatch

Semi-supervised anomaly detection is a common problem, as often the data...

Data-Efficient and Interpretable Tabular Anomaly Detection

Anomaly detection (AD) plays an important role in numerous applications....

Deep Anomaly Detection under Labeling Budget Constraints

Selecting informative data points for expert feedback can significantly ...

DATE: Detecting Anomalies in Text via Self-Supervision of Transformers

Leveraging deep learning models for Anomaly Detection (AD) has seen wide...

Anomaly Detection with Score Distribution Discrimination

Recent studies give more attention to the anomaly detection (AD) methods...

Weakly-supervised Deep Anomaly Detection with Pairwise Relation Learning

This paper studies a rarely explored but critical anomaly detection prob...

Postulating Exoplanetary Habitability via a Novel Anomaly Detection Method

A profound shift in the study of cosmology came with the discovery of th...

Please sign up or login with your details

Forgot password? Click here to reset