Spatio-Temporal Graph Complementary Scattering Networks

10/23/2021
by   Zida Cheng, et al.
0

Spatio-temporal graph signal analysis has a significant impact on a wide range of applications, including hand/body pose action recognition. To achieve effective analysis, spatio-temporal graph convolutional networks (ST-GCN) leverage the powerful learning ability to achieve great empirical successes; however, those methods need a huge amount of high-quality training data and lack theoretical interpretation. To address this issue, the spatio-temporal graph scattering transform (ST-GST) was proposed to put forth a theoretically interpretable framework; however, the empirical performance of this approach is constrainted by the fully mathematical design. To benefit from both sides, this work proposes a novel complementary mechanism to organically combine the spatio-temporal graph scattering transform and neural networks, resulting in the proposed spatio-temporal graph complementary scattering networks (ST-GCSN). The essence is to leverage the mathematically designed graph wavelets with pruning techniques to cover major information and use trainable networks to capture complementary information. The empirical experiments on hand pose action recognition show that the proposed ST-GCSN outperforms both ST-GCN and ST-GST.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2020

Spatio-Temporal Graph Scattering Transform

Although spatio-temporal graph neural networks have achieved great empir...
research
11/07/2020

On the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition

Graph convolutional networks (GCNs) achieved promising performance in sk...
research
05/14/2021

REGINA - Reasoning Graph Convolutional Networks in Human Action Recognition

It is known that the kinematics of the human body skeleton reveals valua...
research
11/10/2018

Skeleton-Based Action Recognition with Synchronous Local and Non-local Spatio-temporal Learning and Frequency Attention

Benefiting from its succinctness and robustness, skeleton-based human ac...
research
11/30/2021

How to quantify fields or textures? A guide to the scattering transform

Extracting information from stochastic fields or textures is a ubiquitou...
research
03/24/2020

Capturing and Explaining Trajectory Singularities using Composite Signal Neural Networks

Spatial trajectories are ubiquitous and complex signals. Their analysis ...
research
05/09/2017

Deep Spatio-temporal Manifold Network for Action Recognition

Visual data such as videos are often sampled from complex manifold. We p...

Please sign up or login with your details

Forgot password? Click here to reset