ESAD: End-to-end Deep Semi-supervised Anomaly Detection

12/09/2020
by   Chaoqin Huang, et al.
0

This paper explores semi-supervised anomaly detection, a more practical setting for anomaly detection where a small set of labeled outlier samples are provided in addition to a large amount of unlabeled data for training. Rethinking the optimization target of anomaly detection, we propose a new objective function that measures the KL-divergence between normal and anomalous data, and prove that two factors: the mutual information between the data and latent representations, and the entropy of latent representations, constitute an integral objective function for anomaly detection. To resolve the contradiction in simultaneously optimizing the two factors, we propose a novel encoder-decoder-encoder structure, with the first encoder focusing on optimizing the mutual information and the second encoder focusing on optimizing the entropy. The two encoders are enforced to share similar encoding with a consistent constraint on their latent representations. Extensive experiments have revealed that the proposed method significantly outperforms several state-of-the-arts on multiple benchmark datasets, including medical diagnosis and several classic anomaly detection benchmarks.

READ FULL TEXT
research
06/06/2019

Deep Semi-Supervised Anomaly Detection

Deep approaches to anomaly detection have recently shown promising resul...
research
12/09/2020

Deep Unsupervised Image Anomaly Detection: An Information Theoretic Framework

Surrogate task based methods have recently shown great promise for unsup...
research
03/28/2022

Semi-supervised anomaly detection algorithm based on KL divergence (SAD-KL)

The unlabeled data are generally assumed to be normal data in detecting ...
research
11/25/2019

Inverse-Transform AutoEncoder for Anomaly Detection

Reconstruction-based methods have recently shown great promise for anoma...
research
03/17/2019

Learning Competitive and Discriminative Reconstructions for Anomaly Detection

Most of the existing methods for anomaly detection use only positive dat...
research
03/11/2023

Anomaly Detection with Ensemble of Encoder and Decoder

Hacking and false data injection from adversaries can threaten power gri...
research
03/17/2023

GADFormer: An Attention-based Model for Group Anomaly Detection on Trajectories

Group Anomaly Detection (GAD) reveals anomalous behavior among groups co...

Please sign up or login with your details

Forgot password? Click here to reset