TraHGR: Few-shot Learning for Hand Gesture Recognition via ElectroMyography

03/28/2022
by   Soheil Zabihi, et al.
0

Deep learning-based Hand Gesture Recognition (HGR) via surface Electromyogram (sEMG) signals has recently shown significant potential for development of advanced myoelectric-controlled prosthesis. Existing deep learning approaches, typically, include only one model as such can hardly maintain acceptable generalization performance in changing scenarios. In this paper, we aim to address this challenge by capitalizing on the recent advances of hybrid models and transformers. In other words, we propose a hybrid framework based on the transformer architecture, which is a relatively new and revolutionizing deep learning model. The proposed hybrid architecture, referred to as the Transformer for Hand Gesture Recognition (TraHGR), consists of two parallel paths followed by a linear layer that acts as a fusion center to integrate the advantage of each module and provide robustness over different scenarios. We evaluated the proposed architecture TraHGR based on the commonly used second Ninapro dataset, referred to as the DB2. The sEMG signals in the DB2 dataset are measured in the real-life conditions from 40 healthy users, each performing 49 gestures. We have conducted extensive set of experiments to test and validate the proposed TraHGR architecture, and have compared its achievable accuracy with more than five recently proposed HGR classification algorithms over the same dataset. We have also compared the results of the proposed TraHGR architecture with each individual path and demonstrated the distinguishing power of the proposed hybrid architecture. The recognition accuracies of the proposed TraHGR architecture are 86.18 2.48 DB2 (49 gestures), DB2-B (17 gestures), DB2-C (23 gestures), and DB2-D (9 gestures), respectively.

READ FULL TEXT

page 1

page 5

page 7

page 8

research
01/25/2022

ViT-HGR: Vision Transformer-based Hand Gesture Recognition from High Density Surface EMG Signals

Recently, there has been a surge of significant interest on application ...
research
12/16/2022

Fast Learning of Dynamic Hand Gesture Recognition with Few-Shot Learning Models

We develop Few-Shot Learning models trained to recognize five or ten dif...
research
09/25/2021

TEMGNet: Deep Transformer-based Decoding of Upperlimb sEMG for Hand Gestures Recognition

There has been a surge of recent interest in Machine Learning (ML), part...
research
12/07/2015

Recognition from Hand Cameras

We revisit the study of a wrist-mounted camera system (referred to as Ha...
research
11/04/2022

A Transformer Architecture for Online Gesture Recognition of Mathematical Expressions

The Transformer architecture is shown to provide a powerful framework as...
research
10/27/2022

Light-weighted CNN-Attention based architecture for Hand Gesture Recognition via ElectroMyography

Advancements in Biological Signal Processing (BSP) and Machine-Learning ...

Please sign up or login with your details

Forgot password? Click here to reset