Skeleton-based Action Recognition via Temporal-Channel Aggregation

05/31/2022
by   Shengqin Wang, et al.
0

Skeleton-based action recognition methods are limited by the semantic extraction of spatio-temporal skeletal maps. However, current methods have difficulty in effectively combining features from both temporal and spatial graph dimensions and tend to be thick on one side and thin on the other. In this paper, we propose a Temporal-Channel Aggregation Graph Convolutional Networks (TCA-GCN) to learn spatial and temporal topologies dynamically and efficiently aggregate topological features in different temporal and channel dimensions for skeleton-based action recognition. We use the Temporal Aggregation module to learn temporal dimensional features and the Channel Aggregation module to efficiently combine spatial dynamic topological features learned using Channel-wise with temporal dynamic topological features. In addition, we extract multi-scale skeletal features on temporal modeling and fuse them with priori skeletal knowledge with an attention mechanism. Extensive experiments show that our model results outperform state-of-the-art methods on the NTU RGB+D, NTU RGB+D 120, and NW-UCLA datasets.

READ FULL TEXT

page 3

page 4

page 9

research
02/25/2023

Temporal-Channel Topology Enhanced Network for Skeleton-Based Action Recognition

Skeleton-based action recognition has become popular in recent years due...
research
02/17/2023

Dynamic Spatial-temporal Hypergraph Convolutional Network for Skeleton-based Action Recognition

Skeleton-based action recognition relies on the extraction of spatial-te...
research
04/23/2023

TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential

Skeleton-based action recognition has achieved remarkable results in hum...
research
12/05/2020

Multi Scale Temporal Graph Networks For Skeleton-based Action Recognition

Graph convolutional networks (GCNs) can effectively capture the features...
research
10/12/2022

DG-STGCN: Dynamic Spatial-Temporal Modeling for Skeleton-based Action Recognition

Graph convolution networks (GCN) have been widely used in skeleton-based...
research
07/19/2021

UNIK: A Unified Framework for Real-world Skeleton-based Action Recognition

Action recognition based on skeleton data has recently witnessed increas...
research
03/19/2020

Temporal Extension Module for Skeleton-Based Action Recognition

We present a module that extends the temporal graph of a graph convoluti...

Please sign up or login with your details

Forgot password? Click here to reset