Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition

10/23/2020
by   Negar Heidari, et al.
6

Graph convolutional networks (GCNs) have been very successful in modeling non-Euclidean data structures, like sequences of body skeletons forming actions modeled as spatio-temporal graphs. Most GCN-based action recognition methods use deep feed-forward networks with high computational complexity to process all skeletons in an action. This leads to a high number of floating point operations (ranging from 16G to 100G FLOPs) to process a single sample, making their adoption in restricted computation application scenarios infeasible. In this paper, we propose a temporal attention module (TAM) for increasing the efficiency in skeleton-based action recognition by selecting the most informative skeletons of an action at the early layers of the network. We incorporate the TAM in a light-weight GCN topology to further reduce the overall number of computations. Experimental results on two benchmark datasets show that the proposed method outperforms with a large margin the baseline GCN-based method while having 2.9 times less number of computations. Moreover, it performs on par with the state-of-the-art with up to 9.6 times less number of computations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2020

Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition

Graph convolutional networks (GCNs) have been very successful in skeleto...
research
11/07/2020

On the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition

Graph convolutional networks (GCNs) achieved promising performance in sk...
research
12/15/2019

Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networks

Graph convolutional networks (GCNs), which generalize CNNs to more gener...
research
05/30/2023

High-Performance Inference Graph Convolutional Networks for Skeleton-Based Action Recognition

Recently, significant achievements have been made in skeleton-based huma...
research
10/20/2020

Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognition

One essential problem in skeleton-based action recognition is how to ext...
research
05/14/2021

REGINA - Reasoning Graph Convolutional Networks in Human Action Recognition

It is known that the kinematics of the human body skeleton reveals valua...
research
03/31/2022

SpatioTemporal Focus for Skeleton-based Action Recognition

Graph convolutional networks (GCNs) are widely adopted in skeleton-based...

Please sign up or login with your details

Forgot password? Click here to reset