Supervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning

04/24/2021
by   Zhi Chen, et al.
0

Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional unsupervised anomaly detectors are suboptimal while supervised models can easily make biased predictions towards normal data. In this paper, we present a new supervised anomaly detector through introducing the novel Ensemble Active Learning Generative Adversarial Network (EAL-GAN). EAL-GAN is a conditional GAN having a unique one generator vs. multiple discriminators architecture where anomaly detection is implemented by an auxiliary classifier of the discriminator. In addition to using the conditional GAN to generate class balanced supplementary training data, an innovative ensemble learning loss function ensuring each discriminator makes up for the deficiencies of the others is designed to overcome the class imbalanced problem, and an active learning algorithm is introduced to significantly reduce the cost of labeling real-world data. We present extensive experimental results to demonstrate that the new anomaly detector consistently outperforms a variety of SOTA methods by significant margins. The codes are available on Github.

READ FULL TEXT

page 14

page 16

research
04/02/2019

Fence GAN: Towards Better Anomaly Detection

Anomaly detection is a classical problem where the aim is to detect anom...
research
12/14/2020

GAN Ensemble for Anomaly Detection

When formulated as an unsupervised learning problem, anomaly detection o...
research
09/17/2018

Active Anomaly Detection via Ensembles

In critical applications of anomaly detection including computer securit...
research
02/15/2021

Multi-class Classification Based Anomaly Detection of Insider Activities

Insider threats are the cyber attacks from within the trusted entities o...
research
08/16/2022

Federated Multi-Discriminator BiWGAN-GP based Collaborative Anomaly Detection for Virtualized Network Slicing

Virtualized network slicing allows a multitude of logical networks to be...
research
12/31/2021

on the effectiveness of generative adversarial network on anomaly detection

Identifying anomalies refers to detecting samples that do not resemble t...

Please sign up or login with your details

Forgot password? Click here to reset