A neural network based on SPD manifold learning for skeleton-based hand gesture recognition

by   Xuan Son NGuyen, et al.

This paper proposes a new neural network based on SPD manifold learning for skeleton-based hand gesture recognition. Given the stream of hand's joint positions, our approach combines two aggregation processes on respectively spatial and temporal domains. The pipeline of our network architecture consists in three main stages. The first stage is based on a convolutional layer to increase the discriminative power of learned features. The second stage relies on different architectures for spatial and temporal Gaussian aggregation of joint features. The third stage learns a final SPD matrix from skeletal data. A new type of layer is proposed for the third stage, based on a variant of stochastic gradient descent on Stiefel manifolds. The proposed network is validated on two challenging datasets and shows state-of-the-art accuracies on both datasets.


page 1

page 2

page 3

page 4


Skeleton-Based Hand Gesture Recognition by Learning SPD Matrices with Neural Networks

In this paper, we propose a new hand gesture recognition method based on...

Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attention

We propose a Dynamic Graph-Based Spatial-Temporal Attention (DG-STA) met...

HGR-Net: A Two-stage Convolutional Neural Network for Hand Gesture Segmentation and Recognition

Robust recognition of hand gesture in real-world applications is still a...

Ensemble One-dimensional Convolution Neural Networks for Skeleton-based Action Recognition

In this paper, we proposed a effective but extensible residual one-dimen...

Masked Conditional Neural Networks for Audio Classification

We present the ConditionaL Neural Network (CLNN) and the Masked Conditio...

Please sign up or login with your details

Forgot password? Click here to reset