Hierarchical Deep Temporal Models for Group Activity Recognition

by   Mostafa S. Ibrahim, et al.

In this paper we present an approach for classifying the activity performed by a group of people in a video sequence. This problem of group activity recognition can be addressed by examining individual person actions and their relations. Temporal dynamics exist both at the level of individual person actions as well as at the level of group activity. Given a video sequence as input, methods can be developed to capture these dynamics at both person-level and group-level detail. We build a deep model to capture these dynamics based on LSTM (long short-term memory) models. In order to model both person-level and group-level dynamics, we present a 2-stage deep temporal model for the group activity recognition problem. In our approach, one LSTM model is designed to represent action dynamics of individual people in a video sequence and another LSTM model is designed to aggregate person-level information for group activity recognition. We collected a new dataset consisting of volleyball videos labeled with individual and group activities in order to evaluate our method. Experimental results on this new Volleyball Dataset and the standard benchmark Collective Activity Dataset demonstrate the efficacy of the proposed models.



There are no comments yet.


page 2

page 5

page 6

page 8

page 9

page 10

page 11

page 12


Pose is all you need: The pose only group activity recognition system (POGARS)

We introduce a novel deep learning based group activity recognition appr...

Multi-Level Sequence GAN for Group Activity Recognition

We propose a novel semi-supervised, Multi-Level Sequential Generative Ad...

ReHAR: Robust and Efficient Human Activity Recognition

Designing a scheme that can achieve a good performance in predicting sin...

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...

Panoramic Human Activity Recognition

To obtain a more comprehensive activity understanding for a crowded scen...

Detector-Free Weakly Supervised Group Activity Recognition

Group activity recognition is the task of understanding the activity con...

Learning Group Activities from Skeletons without Individual Action Labels

To understand human behavior we must not just recognize individual actio...

Code Repositories


Paper ibrahim et al, cvpr 2016 - A Hierarchical Deep Temporal Model for Group Activity Recognition -

view repo


a copy from https://github.com/mostafa-saad/deep-activity-rec

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.