DeepAI AI Chat
Log In Sign Up

Latent Embeddings for Collective Activity Recognition

by   Yongyi Tang, et al.

Rather than simply recognizing the action of a person individually, collective activity recognition aims to find out what a group of people is acting in a collective scene. Previ- ous state-of-the-art methods using hand-crafted potentials in conventional graphical model which can only define a limited range of relations. Thus, the complex structural de- pendencies among individuals involved in a collective sce- nario cannot be fully modeled. In this paper, we overcome these limitations by embedding latent variables into feature space and learning the feature mapping functions in a deep learning framework. The embeddings of latent variables build a global relation containing person-group interac- tions and richer contextual information by jointly modeling broader range of individuals. Besides, we assemble atten- tion mechanism during embedding for achieving more com- pact representations. We evaluate our method on three col- lective activity datasets, where we contribute a much larger dataset in this work. The proposed model has achieved clearly better performance as compared to the state-of-the- art methods in our experiments.


page 1

page 2

page 3

page 4


Pose is all you need: The pose only group activity recognition system (POGARS)

We introduce a novel deep learning based group activity recognition appr...

Learning Actor Relation Graphs for Group Activity Recognition

Modeling relation between actors is important for recognizing group acti...

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...

Who did What at Where and When: Simultaneous Multi-Person Tracking and Activity Recognition

We present a bootstrapping framework to simultaneously improve multi-per...

Skeleton-based Relational Reasoning for Group Activity Analysis

Research on group activity recognition mostly leans on standard two-stre...

Attentive pooling for Group Activity Recognition

In group activity recognition, hierarchical framework is widely adopted ...

Activity-Aware Deep Cognitive Fatigue Assessment using Wearables

Cognitive fatigue has been a common problem among workers which has beco...