Anomaly Detection with Prototype-Guided Discriminative Latent Embeddings

04/30/2021
by   Yuandu Lai, et al.
0

Recent efforts towards video anomaly detection try to learn a deep autoencoder to describe normal event patterns with small reconstruction errors. The video inputs with large reconstruction errors are regarded as anomalies at the test time. However, these methods sometimes reconstruct abnormal inputs well because of the powerful generalization ability of deep autoencoder. To address this problem, we present a novel approach for anomaly detection, which utilizes discriminative prototypes of normal data to reconstruct video frames. In this way, the model will favor the reconstruction of normal events and distort the reconstruction of abnormal events. Specifically, we use a prototype-guided memory module to perform discriminative latent embedding. We introduce a new discriminative criterion for the memory module, as well as a loss function correspondingly, which can encourage memory items to record the representative embeddings of normal data, i.e. prototypes. Besides, we design a novel two-branch autoencoder, which is composed of a future frame prediction network and an RGB difference generation network that share the same encoder. The stacked RGB difference contains motion information just like optical flow, so our model can learn temporal regularity. We evaluate the effectiveness of our method on three benchmark datasets and experimental results demonstrate the proposed method outperforms the state-of-the-art.

READ FULL TEXT

page 2

page 5

research
03/30/2020

Learning Memory-guided Normality for Anomaly Detection

We address the problem of anomaly detection, that is, detecting anomalou...
research
03/09/2023

Multi-level Memory-augmented Appearance-Motion Correspondence Framework for Video Anomaly Detection

Frame prediction based on AutoEncoder plays a significant role in unsupe...
research
08/25/2021

Normal Learning in Videos with Attention Prototype Network

Frame reconstruction (current or future frame) based on Auto-Encoder (AE...
research
08/16/2021

A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame Prediction

In this paper, we propose $\text{HF}^2$-VAD, a Hybrid framework that int...
research
04/29/2021

Discriminative-Generative Dual Memory Video Anomaly Detection

Recently, people tried to use a few anomalies for video anomaly detectio...
research
01/29/2021

Re Learning Memory Guided Normality for Anomaly Detection

The authors have introduced a novel method for unsupervised anomaly dete...
research
03/07/2022

Object-centric and memory-guided normality reconstruction for video anomaly detection

This paper addresses video anomaly detection problem for videosurveillan...

Please sign up or login with your details

Forgot password? Click here to reset