Autoencoding Binary Classifiers for Supervised Anomaly Detection

03/26/2019
by   Yuki Yamanaka, et al.
0

We propose the Autoencoding Binary Classifiers (ABC), a novel supervised anomaly detector based on the Autoencoder (AE). There are two main approaches in anomaly detection: supervised and unsupervised. The supervised approach accurately detects the known anomalies included in training data, but it cannot detect the unknown anomalies. Meanwhile, the unsupervised approach can detect both known and unknown anomalies that are located away from normal data points. However, it does not detect known anomalies as accurately as the supervised approach. Furthermore, even if we have labeled normal data points and anomalies, the unsupervised approach cannot utilize these labels. The ABC is a probabilistic binary classifier that effectively exploits the label information, where normal data points are modeled using the AE as a component. By maximizing the likelihood, the AE in the proposed ABC is trained to minimize the reconstruction error for normal data points, and to maximize it for known anomalies. Since our approach becomes able to reconstruct the normal data points accurately and fails to reconstruct the known and unknown anomalies, it can accurately discriminate both known and unknown anomalies from normal data points. Experimental results show that the ABC achieves higher detection performance than existing supervised and unsupervised methods.

READ FULL TEXT
research
05/17/2023

Reconstruction Error-based Anomaly Detection with Few Outlying Examples

Reconstruction error-based neural architectures constitute a classical d...
research
12/21/2019

AEGR: A simple approach to gradient reversal in autoencoders for network anomaly detection

Anomaly detection is referred to as a process in which the aim is to det...
research
04/24/2019

GAN Augmented Text Anomaly Detection with Sequences of Deep Statistics

Anomaly detection is the process of finding data points that deviate fro...
research
09/06/2021

Postulating Exoplanetary Habitability via a Novel Anomaly Detection Method

A profound shift in the study of cosmology came with the discovery of th...
research
06/15/2023

Unsupervised Anomaly Detection via Nonlinear Manifold Learning

Anomalies are samples that significantly deviate from the rest of the da...
research
11/24/2022

Meta-Learning for Automated Selection of Anomaly Detectors for Semi-Supervised Datasets

In anomaly detection, a prominent task is to induce a model to identify ...
research
09/06/2021

gen2Out: Detecting and Ranking Generalized Anomalies

In a cloud of m-dimensional data points, how would we spot, as well as r...

Please sign up or login with your details

Forgot password? Click here to reset