American Sign Language Identification Using Hand Trackpoint Analysis

10/20/2020
by   Yugam Bajaj, et al.
0

Sign Language helps people with Speaking and Hearing Disabilities communicate with others efficiently. Sign Language identification is a challenging area in the field of computer vision and recent developments have been able to achieve near perfect results for the task, though some challenges are yet to be solved. In this paper we propose a novel machine learning based pipeline for American Sign Language identification using hand track points. We convert a hand gesture into a series of hand track point coordinates that serve as an input to our system. In order to make the solution more efficient, we experimented with 28 different combinations of pre-processing techniques, each run on three different machine learning algorithms namely k-Nearest Neighbours, Random Forests and a Neural Network. Their performance was contrasted to determine the best pre-processing scheme and Algorithm Pair. Our system achieved an Accuracy of 95.66

READ FULL TEXT
research
05/09/2023

Mediapipe and CNNs for Real-Time ASL Gesture Recognition

This research paper describes a realtime system for identifying American...
research
08/14/2022

BDSL 49: A Comprehensive Dataset of Bangla Sign Language

Language is a method by which individuals express their thoughts. Each l...
research
10/01/2021

Phonology Recognition in American Sign Language

Inspired by recent developments in natural language processing, we propo...
research
04/13/2022

Efficient Deep Learning-based Estimation of the Vital Signs on Smartphones

Nowadays, due to the widespread use of smartphones in everyday life and ...
research
04/14/2022

Open Source HamNoSys Parser for Multilingual Sign Language Encoding

This paper presents our recent developments in the field of automatic pr...
research
01/17/2019

Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech

Recent advancements in the field of computer vision with the help of dee...
research
10/01/2020

A Multi-modal Machine Learning Approach and Toolkit to Automate Recognition of Early Stages of Dementia among British Sign Language Users

The ageing population trend is correlated with an increased prevalence o...

Please sign up or login with your details

Forgot password? Click here to reset