Richlt Activated Graph Convolutional Network for Action Recognition with Incomplete Skeletons

05/16/2019
by   Yi-Fan Song, et al.
6

Current methods for skeleton-based human action recognition usually work with completely observed skeletons. However, in real scenarios, it is prone to capture incomplete and noisy skeletons, which will deteriorate the performance of traditional models. To enhance the robustness of action recognition models to incomplete skeletons, we propose a multi-stream graph convolutional network (GCN) for exploring sufficient discriminative features distributed over all skeleton joints. Here, each stream of the network is only responsible for learning features from currently unactivated joints, which are distinguished by the class activation maps (CAM) obtained by preceding streams, so that the activated joints of the proposed method are obviously more than traditional methods. Thus, the proposed method is termed richly activated GCN (RA-GCN), where the richly discovered features will improve the robustness of the model. Compared to the state-of-the-art methods, the RA-GCN achieves comparable performance on the NTU RGB+D dataset. Moreover, on a synthetic occlusion dataset, the performance deterioration can be alleviated by the RA-GCN significantly.

READ FULL TEXT
research
05/16/2019

Richly Activated Graph Convolutional Network for Action Recognition with Incomplete Skeletons

Current methods for skeleton-based human action recognition usually work...
research
08/09/2020

Richly Activated Graph Convolutional Network for Robust Skeleton-based Action Recognition

Current methods for skeleton-based human action recognition usually work...
research
03/17/2020

Predictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition

In skeleton-based action recognition, graph convolutional networks (GCNs...
research
11/16/2020

JOLO-GCN: Mining Joint-Centered Light-Weight Information for Skeleton-Based Action Recognition

Skeleton-based action recognition has attracted research attentions in r...
research
06/30/2022

Skeleton-based Action Recognition via Adaptive Cross-Form Learning

Skeleton-based action recognition aims to project skeleton sequences to ...
research
11/11/2019

Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searching

Human action recognition from skeleton data, fueled by the Graph Convolu...
research
06/29/2021

Constructing Stronger and Faster Baselines for Skeleton-based Action Recognition

One essential problem in skeleton-based action recognition is how to ext...

Please sign up or login with your details

Forgot password? Click here to reset