Simple Adaptive Projection with Pretrained Features for Anomaly Detection

12/05/2021
by   Xingtai Gui, et al.
0

Deep anomaly detection aims to separate anomaly from normal samples with high-quality representations. Pretrained features bring effective representation and promising anomaly detection performance. However, with one-class training data, adapting the pretrained features is a thorny problem. Specifically, the existing optimization objectives with global target often lead to pattern collapse, i.e. all inputs are mapped to the same. In this paper, we propose a novel adaptation framework including simple linear transformation and self-attention. Such adaptation is applied on a specific input, and its k nearest representations of normal samples in pretrained feature space and the inner-relationship between similar one-class semantic features are mined. Furthermore, based on such framework, we propose an effective constraint term to avoid learning trivial solution. Our simple adaptive projection with pretrained features(SAP2) yields a novel anomaly detection criterion which is more accurate and robust to pattern collapse. Our method achieves state-of-the-art anomaly detection performance on semantic anomaly detection and sensory anomaly detection benchmarks including 96.5 AUROC on CIFAR-100 dataset, 97.0 MvTec dataset.

READ FULL TEXT

page 6

page 7

page 8

research
10/05/2020

Deep Anomaly Detection by Residual Adaptation

Deep anomaly detection is a difficult task since, in high dimensions, it...
research
10/12/2020

PANDA – Adapting Pretrained Features for Anomaly Detection

Anomaly detection methods require high-quality features. One way of obta...
research
06/07/2021

Mean-Shifted Contrastive Loss for Anomaly Detection

Deep anomaly detection methods learn representations that separate betwe...
research
11/17/2020

Sub-clusters of Normal Data for Anomaly Detection

Anomaly detection in data analysis is an interesting but still challengi...
research
12/31/2021

TransLog: A Unified Transformer-based Framework for Log Anomaly Detection

Log anomaly detection is a key component in the field of artificial inte...
research
05/22/2021

Feature Encoding with AutoEncoders for Weakly-supervised Anomaly Detection

Weakly-supervised anomaly detection aims at learning an anomaly detector...
research
08/20/2019

CBOWRA: A Representation Learning Approach for Medication Anomaly Detection

Electronic health record is an important source for clinical researches ...

Please sign up or login with your details

Forgot password? Click here to reset