MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection

04/04/2021
by   Jia-Chang Feng, et al.
0

Weakly supervised video anomaly detection (WS-VAD) is to distinguish anomalies from normal events based on discriminative representations. Most existing works are limited in insufficient video representations. In this work, we develop a multiple instance self-training framework (MIST)to efficiently refine task-specific discriminative representations with only video-level annotations. In particular, MIST is composed of 1) a multiple instance pseudo label generator, which adapts a sparse continuous sampling strategy to produce more reliable clip-level pseudo labels, and 2) a self-guided attention boosted feature encoder that aims to automatically focus on anomalous regions in frames while extracting task-specific representations. Moreover, we adopt a self-training scheme to optimize both components and finally obtain a task-specific feature encoder. Extensive experiments on two public datasets demonstrate the efficacy of our method, and our method performs comparably to or even better than existing supervised and weakly supervised methods, specifically obtaining a frame-level AUC 94.83

READ FULL TEXT

page 9

page 10

page 12

research
08/09/2022

Weakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning

Weakly supervised video anomaly detection is a challenging problem due t...
research
03/31/2023

Long-Short Temporal Co-Teaching for Weakly Supervised Video Anomaly Detection

Weakly supervised video anomaly detection (WS-VAD) is a challenging prob...
research
08/23/2022

Towards Open Set Video Anomaly Detection

Open Set Video Anomaly Detection (OpenVAD) aims to identify abnormal eve...
research
03/18/2019

Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection

Video anomaly detection under weak labels is formulated as a typical mul...
research
01/26/2023

Parkinson gait modelling from an anomaly deep representation

Parkinson's Disease is associated with gait movement disorders, such as ...
research
02/10/2023

Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detection

Learning discriminative features for effectively separating abnormal eve...
research
12/16/2022

Weakly Supervised Video Anomaly Detection Based on Cross-Batch Clustering Guidance

Weakly supervised video anomaly detection (WSVAD) is a challenging task ...

Please sign up or login with your details

Forgot password? Click here to reset