DeepAI AI Chat
Log In Sign Up

Latent Embeddings for Collective Activity Recognition

09/20/2017
by   Yongyi Tang, et al.
IEEE
SUN YAT-SEN UNIVERSITY
0

Rather than simply recognizing the action of a person individually, collective activity recognition aims to find out what a group of people is acting in a collective scene. Previ- ous state-of-the-art methods using hand-crafted potentials in conventional graphical model which can only define a limited range of relations. Thus, the complex structural de- pendencies among individuals involved in a collective sce- nario cannot be fully modeled. In this paper, we overcome these limitations by embedding latent variables into feature space and learning the feature mapping functions in a deep learning framework. The embeddings of latent variables build a global relation containing person-group interac- tions and richer contextual information by jointly modeling broader range of individuals. Besides, we assemble atten- tion mechanism during embedding for achieving more com- pact representations. We evaluate our method on three col- lective activity datasets, where we contribute a much larger dataset in this work. The proposed model has achieved clearly better performance as compared to the state-of-the- art methods in our experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/09/2021

Pose is all you need: The pose only group activity recognition system (POGARS)

We introduce a novel deep learning based group activity recognition appr...
04/23/2019

Learning Actor Relation Graphs for Group Activity Recognition

Modeling relation between actors is important for recognizing group acti...
12/26/2018

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...
07/03/2018

Who did What at Where and When: Simultaneous Multi-Person Tracking and Activity Recognition

We present a bootstrapping framework to simultaneously improve multi-per...
11/11/2020

Skeleton-based Relational Reasoning for Group Activity Analysis

Research on group activity recognition mostly leans on standard two-stre...
08/31/2022

Attentive pooling for Group Activity Recognition

In group activity recognition, hierarchical framework is widely adopted ...
05/05/2021

Activity-Aware Deep Cognitive Fatigue Assessment using Wearables

Cognitive fatigue has been a common problem among workers which has beco...