Pose is all you need: The pose only group activity recognition system (POGARS)

08/09/2021
by   Haritha Thilakarathne, et al.
0

We introduce a novel deep learning based group activity recognition approach called the Pose Only Group Activity Recognition System (POGARS), designed to use only tracked poses of people to predict the performed group activity. In contrast to existing approaches for group activity recognition, POGARS uses 1D CNNs to learn spatiotemporal dynamics of individuals involved in a group activity and forgo learning features from pixel data. The proposed model uses a spatial and temporal attention mechanism to infer person-wise importance and multi-task learning for simultaneously performing group and individual action classification. Experimental results confirm that POGARS achieves highly competitive results compared to state-of-the-art methods on a widely used public volleyball dataset despite only using tracked pose as input. Further our experiments show by using pose only as input, POGARS has better generalization capabilities compared to methods that use RGB as input.

READ FULL TEXT
research
07/09/2016

Hierarchical Deep Temporal Models for Group Activity Recognition

In this paper we present an approach for classifying the activity perfor...
research
11/11/2020

Skeleton-based Relational Reasoning for Group Activity Analysis

Research on group activity recognition mostly leans on standard two-stre...
research
08/31/2022

Attentive pooling for Group Activity Recognition

In group activity recognition, hierarchical framework is widely adopted ...
research
09/20/2017

Latent Embeddings for Collective Activity Recognition

Rather than simply recognizing the action of a person individually, coll...
research
12/26/2018

A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition

In this work, we present a framework based on multi-stream convolutional...
research
04/05/2022

Detector-Free Weakly Supervised Group Activity Recognition

Group activity recognition is the task of understanding the activity con...
research
05/14/2021

Learning Group Activities from Skeletons without Individual Action Labels

To understand human behavior we must not just recognize individual actio...

Please sign up or login with your details

Forgot password? Click here to reset