Construct Dynamic Graphs for Hand Gesture Recognition via Spatial-Temporal Attention

07/20/2019
by   Yuxiao Chen, et al.
1

We propose a Dynamic Graph-Based Spatial-Temporal Attention (DG-STA) method for hand gesture recognition. The key idea is to first construct a fully-connected graph from a hand skeleton, where the node features and edges are then automatically learned via a self-attention mechanism that performs in both spatial and temporal domains. We further propose to leverage the spatial-temporal cues of joint positions to guarantee robust recognition in challenging conditions. In addition, a novel spatial-temporal mask is applied to significantly cut down the computational cost by 99 experiments on benchmarks (DHG-14/28 and SHREC'17) and prove the superior performance of our method compared with the state-of-the-art methods. The source code can be found at https://github.com/yuxiaochen1103/DG-STA.

READ FULL TEXT
research
06/25/2021

HAN: An Efficient Hierarchical Self-Attention Network for Skeleton-Based Gesture Recognition

Previous methods for skeleton-based gesture recognition mostly arrange t...
research
02/10/2021

Regional Attention with Architecture-Rebuilt 3D Network for RGB-D Gesture Recognition

Human gesture recognition has drawn much attention in the area of comput...
research
01/11/2022

Optimization Planning for 3D ConvNets

It is not trivial to optimally learn a 3D Convolutional Neural Networks ...
research
11/17/2018

Skeleton-based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module

The skeleton based gesture recognition is gaining more popularity due to...
research
04/29/2019

A neural network based on SPD manifold learning for skeleton-based hand gesture recognition

This paper proposes a new neural network based on SPD manifold learning ...
research
07/01/2022

Literature on Hand GESTURE Recognition using Graph based methods

Skeleton based recognition systems are gaining popularity and machine le...
research
09/22/2021

Natural Typing Recognition via Surface Electromyography

By using a computer keyboard as a finger recording device, we construct ...

Please sign up or login with your details

Forgot password? Click here to reset