Continuous Gesture Recognition from sEMG Sensor Data with Recurrent Neural Networks and Adversarial Domain Adaptation

by   Ivan Sosin, et al.

Movement control of artificial limbs has made big advances in recent years. New sensor and control technology enhanced the functionality and usefulness of artificial limbs to the point that complex movements, such as grasping, can be performed to a limited extent. To date, the most successful results were achieved by applying recurrent neural networks (RNNs). However, in the domain of artificial hands, experiments so far were limited to non-mobile wrists, which significantly reduces the functionality of such prostheses. In this paper, for the first time, we present empirical results on gesture recognition with both mobile and non-mobile wrists. Furthermore, we demonstrate that recurrent neural networks with simple recurrent units (SRU) outperform regular RNNs in both cases in terms of gesture recognition accuracy, on data acquired by an arm band sensing electromagnetic signals from arm muscles (via surface electromyography or sEMG). Finally, we show that adding domain adaptation techniques to continuous gesture recognition with RNN improves the transfer ability between subjects, where a limb controller trained on data from one person is used for another person.


Domain Adaptation for sEMG-based Gesture Recognition with Recurrent Neural Networks

Surface Electromyography (sEMG) is to record muscles' electrical activit...

Artificial Neural Networks for Sensor Data Classification on Small Embedded Systems

In this paper we investigate the usage of machine learning for interpret...

Exploiting Recurrent Neural Networks and Leap Motion Controller for Sign Language and Semaphoric Gesture Recognition

In human interactions, hands are a powerful way of expressing informatio...

Motion Feature Augmented Recurrent Neural Network for Skeleton-based Dynamic Hand Gesture Recognition

Dynamic hand gesture recognition has attracted increasing interests beca...

Dynamic Hand Gesture Recognition for Wearable Devices with Low Complexity Recurrent Neural Networks

Gesture recognition is a very essential technology for many wearable dev...

ABHIVYAKTI: A Vision Based Intelligent System for Elder and Sick Persons

This paper describes an intelligent system ABHIVYAKTI, which would be pe...

On the Metrics and Adaptation Methods for Domain Divergences of sEMG-based Gesture Recognition

We propose a new metric to measure domain divergence and a new domain ad...

Please sign up or login with your details

Forgot password? Click here to reset