Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks

by   Jefferson Ryan Medel, et al.

Automating the detection of anomalous events within long video sequences is challenging due to the ambiguity of how such events are defined. We approach the problem by learning generative models that can identify anomalies in videos using limited supervision. We propose end-to-end trainable composite Convolutional Long Short-Term Memory (Conv-LSTM) networks that are able to predict the evolution of a video sequence from a small number of input frames. Regularity scores are derived from the reconstruction errors of a set of predictions with abnormal video sequences yielding lower regularity scores as they diverge further from the actual sequence over time. The models utilize a composite structure and examine the effects of conditioning in learning more meaningful representations. The best model is chosen based on the reconstruction and prediction accuracy. The Conv-LSTM models are evaluated both qualitatively and quantitatively, demonstrating competitive results on anomaly detection datasets. Conv-LSTM units are shown to be an effective tool for modeling and predicting video sequences.


page 12

page 14

page 15

page 16

page 17

page 19

page 20

page 21


Anomaly detection using prediction error with Spatio-Temporal Convolutional LSTM

In this paper, we propose a novel method for video anomaly detection mot...

Learning Temporal Regularity in Video Sequences

Perceiving meaningful activities in a long video sequence is a challengi...

Driving Anomaly Detection Using Conditional Generative Adversarial Network

Anomaly driving detection is an important problem in advanced driver ass...

Deep Learning for System Trace Restoration

Most real-world datasets, and particularly those collected from physical...

Pinpointing Anomaly Events in Logs from Stability Testing – N-Grams vs. Deep-Learning

As stability testing execution logs can be very long, software engineers...

Generating multi-type sequences of temporal events to improve fraud detection in game advertising

Fraudulent activities related to online advertising can potentially harm...

Learning Bidirectional LSTM Networks for Synthesizing 3D Mesh Animation Sequences

In this paper, we present a novel method for learning to synthesize 3D m...