Temporal Graph Modeling for Skeleton-based Action Recognition

12/16/2020
by   Jianan Li, et al.
0

Graph Convolutional Networks (GCNs), which model skeleton data as graphs, have obtained remarkable performance for skeleton-based action recognition. Particularly, the temporal dynamic of skeleton sequence conveys significant information in the recognition task. For temporal dynamic modeling, GCN-based methods only stack multi-layer 1D local convolutions to extract temporal relations between adjacent time steps. With the repeat of a lot of local convolutions, the key temporal information with non-adjacent temporal distance may be ignored due to the information dilution. Therefore, these methods still remain unclear how to fully explore temporal dynamic of skeleton sequence. In this paper, we propose a Temporal Enhanced Graph Convolutional Network (TE-GCN) to tackle this limitation. The proposed TE-GCN constructs temporal relation graph to capture complex temporal dynamic. Specifically, the constructed temporal relation graph explicitly builds connections between semantically related temporal features to model temporal relations between both adjacent and non-adjacent time steps. Meanwhile, to further explore the sufficient temporal dynamic, multi-head mechanism is designed to investigate multi-kinds of temporal relations. Extensive experiments are performed on two widely used large-scale datasets, NTU-60 RGB+D and NTU-120 RGB+D. And experimental results show that the proposed model achieves the state-of-the-art performance by making contribution to temporal modeling for action recognition.

READ FULL TEXT
research
10/10/2022

Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph convolutional networks (GCNs), which can model the human body skel...
research
08/24/2023

DD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition

Graph Convolutional Networks (GCNs) have been widely used in skeleton-ba...
research
11/11/2019

Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searching

Human action recognition from skeleton data, fueled by the Graph Convolu...
research
02/27/2018

Spatio-Temporal Graph Convolution for Skeleton Based Action Recognition

Variations of human body skeletons may be considered as dynamic graphs, ...
research
08/23/2022

Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognition

Graph convolutional networks (GCNs) are the most commonly used method fo...
research
04/23/2023

TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential

Skeleton-based action recognition has achieved remarkable results in hum...
research
03/31/2022

SpatioTemporal Focus for Skeleton-based Action Recognition

Graph convolutional networks (GCNs) are widely adopted in skeleton-based...

Please sign up or login with your details

Forgot password? Click here to reset