Detection of Anomalous Crowd Behavior Using Spatio-Temporal Multiresolution Model and Kronecker Sum Decompositions

01/14/2014
by   Kristjan Greenewald, et al.
0

In this work we consider the problem of detecting anomalous spatio-temporal behavior in videos. Our approach is to learn the normative multiframe pixel joint distribution and detect deviations from it using a likelihood based approach. Due to the extreme lack of available training samples relative to the dimension of the distribution, we use a mean and covariance approach and consider methods of learning the spatio-temporal covariance in the low-sample regime. Our approach is to estimate the covariance using parameter reduction and sparse models. The first method considered is the representation of the covariance as a sum of Kronecker products as in (Greenewald et al 2013), which is found to be an accurate approximation in this setting. We propose learning algorithms relevant to our problem. We then consider the sparse multiresolution model of (Choi et al 2010) and apply the Kronecker product methods to it for further parameter reduction, as well as introducing modifications for enhanced efficiency and greater applicability to spatio-temporal covariance matrices. We apply our methods to the detection of crowd behavior anomalies in the University of Minnesota crowd anomaly dataset, and achieve competitive results.

READ FULL TEXT

page 8

page 9

research
05/19/2014

Kronecker PCA Based Spatio-Temporal Modeling of Video for Dismount Classification

We consider the application of KronPCA spatio-temporal modeling techniqu...
research
07/27/2013

Kronecker Sum Decompositions of Space-Time Data

In this paper we consider the use of the space vs. time Kronecker produc...
research
05/25/2021

Conformal Anomaly Detection on Spatio-Temporal Observations with Missing Data

We develop a distribution-free, unsupervised anomaly detection method ca...
research
02/09/2018

Learning Localized Spatio-Temporal Models From Streaming Data

We address the problem of predicting spatio-temporal processes with temp...
research
10/31/2017

Spatio-temporal interaction model for crowd video analysis

We present an unsupervised approach to analyze crowd at various levels o...
research
04/04/2013

Integration of spatio-temporal contrast sensitivity with a multi-slice channelized Hotelling observer

Barten's model of spatio-temporal contrast sensitivity function of human...

Please sign up or login with your details

Forgot password? Click here to reset