Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition

04/26/2019
by   Maosen Li, et al.
0

Action recognition with skeleton data has recently attracted much attention in computer vision. Previous studies are mostly based on fixed skeleton graphs, only capturing local physical dependencies among joints, which may miss implicit joint correlations. To capture richer dependencies, we introduce an encoder-decoder structure, called A-link inference module, to capture action-specific latent dependencies, i.e. actional links, directly from actions. We also extend the existing skeleton graphs to represent higher-order dependencies, i.e. structural links. Combing the two types of links into a generalized skeleton graph, we further propose the actional-structural graph convolution network (AS-GCN), which stacks actional-structural graph convolution and temporal convolution as a basic building block, to learn both spatial and temporal features for action recognition. A future pose prediction head is added in parallel to the recognition head to help capture more detailed action patterns through self-supervision. We validate AS-GCN in action recognition using two skeleton data sets, NTU-RGB+D and Kinetics. The proposed AS-GCN achieves consistently large improvement compared to the state-of-the-art methods. As a side product, AS-GCN also shows promising results for future pose prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/10/2022

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph convolutional networks (GCNs), which can model the human body skel...
research
10/12/2022

DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action Recognition

Graph convolution networks (GCN) have been widely used in skeleton-based...
research
10/05/2019

Symbiotic Graph Neural Networks for 3D Skeleton-based Human Action Recognition and Motion Prediction

3D skeleton-based action recognition and motion prediction are two essen...
research
01/15/2022

Real-World Graph Convolution Networks (RW-GCNs) for Action Recognition in Smart Video Surveillance

Action recognition is a key algorithmic part of emerging on-the-edge sma...
research
05/21/2023

Language Knowledge-Assisted Representation Learning for Skeleton-Based Action Recognition

How humans understand and recognize the actions of others is a complex n...
research
11/29/2018

Generalized Graph Convolutional Networks for Skeleton-based Action Recognition

With the prevalence of accessible depth sensors, dynamic human body skel...
research
03/07/2023

Learning Discriminative Representations for Skeleton Based Action Recognition

Human action recognition aims at classifying the category of human actio...

Please sign up or login with your details

Forgot password? Click here to reset