Hierarchical Deep Temporal Models for Group Activity Recognition

07/09/2016
by   Mostafa S. Ibrahim, et al.
0

In this paper we present an approach for classifying the activity performed by a group of people in a video sequence. This problem of group activity recognition can be addressed by examining individual person actions and their relations. Temporal dynamics exist both at the level of individual person actions as well as at the level of group activity. Given a video sequence as input, methods can be developed to capture these dynamics at both person-level and group-level detail. We build a deep model to capture these dynamics based on LSTM (long short-term memory) models. In order to model both person-level and group-level dynamics, we present a 2-stage deep temporal model for the group activity recognition problem. In our approach, one LSTM model is designed to represent action dynamics of individual people in a video sequence and another LSTM model is designed to aggregate person-level information for group activity recognition. We collected a new dataset consisting of volleyball videos labeled with individual and group activities in order to evaluate our method. Experimental results on this new Volleyball Dataset and the standard benchmark Collective Activity Dataset demonstrate the efficacy of the proposed models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 5

page 6

page 8

page 9

page 10

page 11

page 12

08/09/2021

Pose is all you need: The pose only group activity recognition system (POGARS)

We introduce a novel deep learning based group activity recognition appr...
12/18/2018

Multi-Level Sequence GAN for Group Activity Recognition

We propose a novel semi-supervised, Multi-Level Sequential Generative Ad...
02/27/2018

ReHAR: Robust and Efficient Human Activity Recognition

Designing a scheme that can achieve a good performance in predicting sin...
12/26/2018

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...
03/08/2022

Panoramic Human Activity Recognition

To obtain a more comprehensive activity understanding for a crowded scen...
04/05/2022

Detector-Free Weakly Supervised Group Activity Recognition

Group activity recognition is the task of understanding the activity con...
05/14/2021

Learning Group Activities from Skeletons without Individual Action Labels

To understand human behavior we must not just recognize individual actio...

Code Repositories

deep-activity-rec

Paper ibrahim et al, cvpr 2016 - A Hierarchical Deep Temporal Model for Group Activity Recognition -


view repo

deep-activity-rec

a copy from https://github.com/mostafa-saad/deep-activity-rec


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.