Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection

02/18/2017
by   Tharindu Fernando, et al.
0

As humans we possess an intuitive ability for navigation which we master through years of practice; however existing approaches to model this trait for diverse tasks including monitoring pedestrian flow and detecting abnormal events have been limited by using a variety of hand-crafted features. Recent research in the area of deep-learning has demonstrated the power of learning features directly from the data; and related research in recurrent neural networks has shown exemplary results in sequence-to-sequence problems such as neural machine translation and neural image caption generation. Motivated by these approaches, we propose a novel method to predict the future motion of a pedestrian given a short history of their, and their neighbours, past behaviour. The novelty of the proposed method is the combined attention model which utilises both "soft attention" as well as "hard-wired" attention in order to map the trajectory information from the local neighbourhood to the future positions of the pedestrian of interest. We illustrate how a simple approximation of attention weights (i.e hard-wired) can be merged together with soft attention weights in order to make our model applicable for challenging real world scenarios with hundreds of neighbours. The navigational capability of the proposed method is tested on two challenging publicly available surveillance databases where our model outperforms the current-state-of-the-art methods. Additionally, we illustrate how the proposed architecture can be directly applied for the task of abnormal event detection without handcrafting the features.

READ FULL TEXT

page 12

page 16

page 18

page 22

research
05/26/2017

Human Trajectory Prediction using Spatially aware Deep Attention Models

Trajectory Prediction of dynamic objects is a widely studied topic in th...
research
03/15/2022

SocialVAE: Human Trajectory Prediction using Timewise Latents

Predicting pedestrian movement is critical for human behavior analysis a...
research
10/02/2016

Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection

Most of the crowd abnormal event detection methods rely on complex hand-...
research
07/03/2020

Graph2Kernel Grid-LSTM: A Multi-Cued Model for Pedestrian Trajectory Prediction by Learning Adaptive Neighborhoods

Pedestrian trajectory prediction is a prominent research track that has ...
research
03/26/2019

Adversarially Learned Abnormal Trajectory Classifier

We address the problem of abnormal event detection from trajectory data....
research
12/18/2018

GD-GAN: Generative Adversarial Networks for Trajectory Prediction and Group Detection in Crowds

This paper presents a novel deep learning framework for human trajectory...
research
08/23/2019

Trajectory Prediction by Coupling Scene-LSTM with Human Movement LSTM

We develop a novel human trajectory prediction system that incorporates ...

Please sign up or login with your details

Forgot password? Click here to reset