Elsa: Energy-based learning for semi-supervised anomaly detection

03/29/2021
by   Sungwon Han, et al.
0

Anomaly detection aims at identifying deviant instances from the normal data distribution. Many advances have been made in the field, including the innovative use of unsupervised contrastive learning. However, existing methods generally assume clean training data and are limited when the data contain unknown anomalies. This paper presents Elsa, a novel semi-supervised anomaly detection approach that unifies the concept of energy-based models with unsupervised contrastive learning. Elsa instills robustness against any data contamination by a carefully designed fine-tuning step based on the new energy function that forces the normal data to be divided into classes of prototypes. Experiments on multiple contamination scenarios show the proposed model achieves SOTA performance. Extensive analyses also verify the contribution of each component in the proposed model. Beyond the experiments, we also offer a theoretical interpretation of why contrastive learning alone cannot detect anomalies under data contamination.

READ FULL TEXT

page 8

page 17

research
07/24/2022

Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection

Anomaly detection aims at identifying deviant samples from the normal da...
research
06/21/2022

R2-AD2: Detecting Anomalies by Analysing the Raw Gradient

Neural networks follow a gradient-based learning scheme, adapting their ...
research
05/25/2016

Deep Structured Energy Based Models for Anomaly Detection

In this paper, we attack the anomaly detection problem by directly model...
research
07/04/2022

Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Better Anomaly Detection

Most of anomaly detection algorithms are mainly focused on modeling the ...
research
07/23/2019

A Neural Network Based On-device Learning Anomaly Detector for Edge Devices

Semi-supervised anomaly detection is referred as an approach to identify...
research
09/21/2022

Improving Generalizability of Graph Anomaly Detection Models via Data Augmentation

Graph anomaly detection (GAD) is a vital task since even a few anomalies...
research
08/28/2022

RUAD: unsupervised anomaly detection in HPC systems

The increasing complexity of modern high-performance computing (HPC) sys...

Please sign up or login with your details

Forgot password? Click here to reset