Spatio-Temporal Relation Learning for Video Anomaly Detection

09/27/2022
by   Hui Lv, et al.
0

Anomaly identification is highly dependent on the relationship between the object and the scene, as different/same object actions in same/different scenes may lead to various degrees of normality and anomaly. Therefore, object-scene relation actually plays a crucial role in anomaly detection but is inadequately explored in previous works. In this paper, we propose a Spatial-Temporal Relation Learning (STRL) framework to tackle the video anomaly detection task. First, considering dynamic characteristics of the objects as well as scene areas, we construct a Spatio-Temporal Auto-Encoder (STAE) to jointly exploit spatial and temporal evolution patterns for representation learning. For better pattern extraction, two decoding branches are designed in the STAE module, i.e. an appearance branch capturing spatial cues by directly predicting the next frame, and a motion branch focusing on modeling the dynamics via optical flow prediction. Then, to well concretize the object-scene relation, a Relation Learning (RL) module is devised to analyze and summarize the normal relations by introducing the Knowledge Graph Embedding methodology. Specifically in this process, the plausibility of object-scene relation is measured by jointly modeling object/scene features and optimizable object-scene relation maps. Extensive experiments are conducted on three public datasets, and the superior performance over the state-of-the-art methods demonstrates the effectiveness of our method.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
10/18/2022

Spatio-Temporal-based Context Fusion for Video Anomaly Detection

Video anomaly detection aims to discover abnormal events in videos, and ...
research
06/10/2021

Predicting Next Local Appearance for Video Anomaly Detection

We present a local anomaly detection method in videos. As opposed to mos...
research
08/16/2020

Object-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Grounding

Spatio-temporal video grounding aims to retrieve the spatio-temporal tub...
research
03/23/2023

Hierarchical Semantic Contrast for Scene-aware Video Anomaly Detection

Increasing scene-awareness is a key challenge in video anomaly detection...
research
08/26/2020

Defending Water Treatment Networks: Exploiting Spatio-temporal Effects for Cyber Attack Detection

While Water Treatment Networks (WTNs) are critical infrastructures for l...
research
07/20/2022

Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzles

Video Anomaly Detection (VAD) is an important topic in computer vision. ...
research
03/18/2021

Ano-Graph: Learning Normal Scene Contextual Graphs to Detect Video Anomalies

Video anomaly detection has proved to be a challenging task owing to its...

Please sign up or login with your details

Forgot password? Click here to reset