Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs

04/21/2020
by   Karush Suri, et al.
0

Advancements in gesture recognition algorithms have led to a significant growth in sign language translation. By making use of efficient intelligent models, signs can be recognized with precision. The proposed work presents a novel one-dimensional Convolutional Neural Network (CNN) array architecture for recognition of signs from the Indian sign language using signals recorded from a custom designed wearable IMU device. The IMU device makes use of tri-axial accelerometer and gyroscope. The signals recorded using the IMU device are segregated on the basis of their context, such as whether they correspond to signing for a general sentence or an interrogative sentence. The array comprises of two individual CNNs, one classifying the general sentences and the other classifying the interrogative sentence. Performances of individual CNNs in the array architecture are compared to that of a conventional CNN classifying the unsegregated dataset. Peak classification accuracies of 94.20 for general sentences and 95.00 proposed CNN array in comparison to 93.50 suitability of the proposed approach.

READ FULL TEXT

page 2

page 3

research
04/27/2020

Continuous sign language recognition from wearable IMUs using deep capsule networks and game theory

Sign Language is used by the deaf community all over world. The work pre...
research
05/09/2023

Mediapipe and CNNs for Real-Time ASL Gesture Recognition

This research paper describes a realtime system for identifying American...
research
11/16/2020

A New Dataset and Proposed Convolutional Neural Network Architecture for Classification of American Sign Language Digits

In our interviews with people who work with speech impaired persons, we ...
research
04/20/2023

Indian Sign Language Recognition Using Mediapipe Holistic

Deaf individuals confront significant communication obstacles on a daily...
research
04/27/2020

Classification of Hand Gestures from Wearable IMUs using Deep Neural Network

IMUs are gaining significant importance in the field of hand gesture ana...
research
04/27/2020

Activity Detection from Wearable Electromyogram Sensors using Hidden Markov Model

Surface electromyography (sEMG) has gained significant importance during...
research
04/17/2019

Understanding the Effectiveness of Ultrasonic Microphone Jammer

Recent works have explained the principle of using ultrasonic transmissi...

Please sign up or login with your details

Forgot password? Click here to reset