Energy Efficient Personalized Hand-Gesture Recognition with Neuromorphic Computing

07/11/2023
by   Muhammad Aitsam, et al.
0

Hand gestures are a form of non-verbal communication that is used in social interaction and it is therefore required for more natural human-robot interaction. Neuromorphic (brain-inspired) computing offers a low-power solution for Spiking neural networks (SNNs) that can be used for the classification and recognition of gestures. This article introduces the preliminary results of a novel methodology for training spiking convolutional neural networks for hand-gesture recognition so that a humanoid robot with integrated neuromorphic hardware will be able to personalise the interaction with a user according to the shown hand gesture. It also describes other approaches that could improve the overall performance of the model.

READ FULL TEXT
research
09/21/2021

A Proposed Set of Communicative Gestures for Human Robot Interaction and an RGB Image-based Gesture Recognizer Implemented in ROS

We propose a set of communicative gestures and develop a gesture recogni...
research
06/04/2022

Low Power Neuromorphic EMG Gesture Classification

EMG (Electromyograph) signal based gesture recognition can prove vital f...
research
04/29/2021

Hand Gesture Recognition Based on a Nonconvex Regularization

Recognition of hand gestures is one of the most fundamental tasks in hum...
research
08/03/2020

Online Few-shot Gesture Learning on a Neuromorphic Processor

We present the Surrogate-gradient Online Error-triggered Learning (SOEL)...
research
08/29/2023

Bayesian Integration of Information Using Top-Down Modulated WTA Networks

Winner Take All (WTA) circuits a type of Spiking Neural Networks (SNN) h...
research
07/25/2022

Static Hand Gesture Recognition for American Sign Language using Neuromorphic Hardware

In this paper, we develop four spiking neural network (SNN) models for t...
research
09/29/2022

Evaluating the temporal understanding of neural networks on event-based action recognition with DVS-Gesture-Chain

Enabling artificial neural networks (ANNs) to have temporal understandin...

Please sign up or login with your details

Forgot password? Click here to reset