Latent Embeddings for Collective Activity Recognition

09/20/2017
by   Yongyi Tang, et al.
0

Rather than simply recognizing the action of a person individually, collective activity recognition aims to find out what a group of people is acting in a collective scene. Previ- ous state-of-the-art methods using hand-crafted potentials in conventional graphical model which can only define a limited range of relations. Thus, the complex structural de- pendencies among individuals involved in a collective sce- nario cannot be fully modeled. In this paper, we overcome these limitations by embedding latent variables into feature space and learning the feature mapping functions in a deep learning framework. The embeddings of latent variables build a global relation containing person-group interac- tions and richer contextual information by jointly modeling broader range of individuals. Besides, we assemble atten- tion mechanism during embedding for achieving more com- pact representations. We evaluate our method on three col- lective activity datasets, where we contribute a much larger dataset in this work. The proposed model has achieved clearly better performance as compared to the state-of-the- art methods in our experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2021

Pose is all you need: The pose only group activity recognition system (POGARS)

We introduce a novel deep learning based group activity recognition appr...
research
04/23/2019

Learning Actor Relation Graphs for Group Activity Recognition

Modeling relation between actors is important for recognizing group acti...
research
12/26/2018

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...
research
07/03/2018

Who did What at Where and When: Simultaneous Multi-Person Tracking and Activity Recognition

We present a bootstrapping framework to simultaneously improve multi-per...
research
11/11/2020

Skeleton-based Relational Reasoning for Group Activity Analysis

Research on group activity recognition mostly leans on standard two-stre...
research
03/06/2015

Latent Hierarchical Model for Activity Recognition

We present a novel hierarchical model for human activity recognition. In...
research
05/05/2021

Activity-Aware Deep Cognitive Fatigue Assessment using Wearables

Cognitive fatigue has been a common problem among workers which has beco...

Please sign up or login with your details

Forgot password? Click here to reset