DeepAI AI Chat
Log In Sign Up

Improved Actor Relation Graph based Group Activity Recognition

10/24/2020
by   Zijian Kuang, et al.
University of Alberta
0

Video understanding is to recognize and classify different actions or activities appearing in the video. A lot of previous work, such as video captioning, has shown promising performance in producing general video understanding. However, it is still challenging to generate a fine-grained description of human actions and their interactions using state-of-the-art video captioning techniques. The detailed description of human actions and group activities is essential information, which can be used in real-time CCTV video surveillance, health care, sports video analysis, etc. This study proposes a video understanding method that mainly focused on group activity recognition by learning the pair-wise actor appearance similarity and actor positions. We propose to use Normalized cross-correlation (NCC) and the sum of absolute differences (SAD) to calculate the pair-wise appearance similarity and build the actor relationship graph to allow the graph convolution network to learn how to classify group activities. We also propose to use MobileNet as the backbone to extract features from each video frame. A visualization model is further introduced to visualize each input video frame with predicted bounding boxes on each human object and predict individual action and collective activity.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/28/2020

Actor-Transformers for Group Activity Recognition

This paper strives to recognize individual actions and group activities ...
04/07/2021

The Use of Video Captioning for Fostering Physical Activity

Video Captioning is considered to be one of the most challenging problem...
04/23/2019

Learning Actor Relation Graphs for Group Activity Recognition

Modeling relation between actors is important for recognizing group acti...
05/14/2021

Learning Group Activities from Skeletons without Individual Action Labels

To understand human behavior we must not just recognize individual actio...
11/29/2017

Video Captioning via Hierarchical Reinforcement Learning

Video captioning is the task of automatically generating a textual descr...
04/18/2023

MLP-AIR: An Efficient MLP-Based Method for Actor Interaction Relation Learning in Group Activity Recognition

The task of Group Activity Recognition (GAR) aims to predict the activit...