Learning Temporal Regularity in Video Sequences

by   Mahmudul Hasan, et al.
University of Maryland
Comcast Corporation

Perceiving meaningful activities in a long video sequence is a challenging problem due to ambiguous definition of 'meaningfulness' as well as clutters in the scene. We approach this problem by learning a generative model for regular motion patterns, termed as regularity, using multiple sources with very limited supervision. Specifically, we propose two methods that are built upon the autoencoders for their ability to work with little to no supervision. We first leverage the conventional handcrafted spatio-temporal local features and learn a fully connected autoencoder on them. Second, we build a fully convolutional feed-forward autoencoder to learn both the local features and the classifiers as an end-to-end learning framework. Our model can capture the regularities from multiple datasets. We evaluate our methods in both qualitative and quantitative ways - showing the learned regularity of videos in various aspects and demonstrating competitive performance on anomaly detection datasets as an application.


page 14

page 15

page 16

page 17

page 18

page 19

page 21

page 22


Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks

Automating the detection of anomalous events within long video sequences...

DeepFall -- Non-invasive Fall Detection with Deep Spatio-Temporal Convolutional Autoencoders

Human falls rarely occur; however, detecting falls is very important fro...

Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection

Detecting abnormal activities in real-world surveillance videos is an im...

Detecting Deepfake by Creating Spatio-Temporal Regularity Disruption

Despite encouraging progress in deepfake detection, generalization to un...

Learning to encode motion using spatio-temporal synchrony

We consider the task of learning to extract motion from videos. To this ...

R-C3D: Region Convolutional 3D Network for Temporal Activity Detection

We address the problem of activity detection in continuous, untrimmed vi...

Neural Network Surrogate Models for Absorptivity and Emissivity Spectra of Multiple Elements

Simulations of high energy density physics are expensive in terms of com...

Code Repositories


Implementation of "Learning Temoporal Regularity in Video Sequences" with TensorFlow

view repo

Please sign up or login with your details

Forgot password? Click here to reset