Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzles

07/20/2022
by   Guodong Wang, et al.
0

Video Anomaly Detection (VAD) is an important topic in computer vision. Motivated by the recent advances in self-supervised learning, this paper addresses VAD by solving an intuitive yet challenging pretext task, i.e., spatio-temporal jigsaw puzzles, which is cast as a multi-label fine-grained classification problem. Our method exhibits several advantages over existing works: 1) the spatio-temporal jigsaw puzzles are decoupled in terms of spatial and temporal dimensions, responsible for capturing highly discriminative appearance and motion features, respectively; 2) full permutations are used to provide abundant jigsaw puzzles covering various difficulty levels, allowing the network to distinguish subtle spatio-temporal differences between normal and abnormal events; and 3) the pretext task is tackled in an end-to-end manner without relying on any pre-trained models. Our method outperforms state-of-the-art counterparts on three public benchmarks. Especially on ShanghaiTech Campus, the result is superior to reconstruction and prediction-based methods by a large margin.

READ FULL TEXT
research
10/18/2022

Spatio-Temporal-based Context Fusion for Video Anomaly Detection

Video anomaly detection aims to discover abnormal events in videos, and ...
research
05/18/2022

Anomaly detection using prediction error with Spatio-Temporal Convolutional LSTM

In this paper, we propose a novel method for video anomaly detection mot...
research
03/07/2022

Object-centric and memory-guided normality reconstruction for video anomaly detection

This paper addresses video anomaly detection problem for videosurveillan...
research
03/18/2021

Ano-Graph: Learning Normal Scene Contextual Graphs to Detect Video Anomalies

Video anomaly detection has proved to be a challenging task owing to its...
research
09/27/2022

Spatio-Temporal Relation Learning for Video Anomaly Detection

Anomaly identification is highly dependent on the relationship between t...
research
11/20/2022

Normalizing Flows for Human Pose Anomaly Detection

Video anomaly detection is an ill-posed problem because it relies on man...
research
02/22/2015

Spatio-temporal Video Parsing for Abnormality Detection

Abnormality detection in video poses particular challenges due to the in...

Please sign up or login with your details

Forgot password? Click here to reset