Online interpretation of numeric sign language using 2-d skeletal model

10/15/2014
by   Subhadip Basu, et al.
0

Gesturing is one of the natural modes of human communication. Signs produced by gestures can have a basic meaning coupled with additional information that is layered over the basic meaning of the sign. Sign language is an important example of communicative gestures that are highly structured and well accepted across the world as a communication medium for deaf and dumb. In this paper, an online recognition scheme is proposed to interpret the standard numeric sign language comprising of 10 basic hand symbols. A web camera is used to capture the real time hand movements as input to the system. The basic meaning of the hand gesture is extracted from the input data frame by analysing the shape of the hand, considering its orientation, movement and location to be fixed. The input hand shape is processed to identify the palm structure, fingertips and their relative positions and the presence of the extended thumb. A 2-dimensional skeletal model is generated from the acquired shape information to represent and subsequently interpret the basic meaning of the hand gesture.

READ FULL TEXT

page 1

page 4

research
03/04/2020

FineHand: Learning Hand Shapes for American Sign Language Recognition

American Sign Language recognition is a difficult gesture recognition pr...
research
08/24/2021

Real-time Indian Sign Language (ISL) Recognition

This paper presents a system which can recognise hand poses gestures...
research
02/15/2023

Fine-tuning of sign language recognition models: a technical report

Sign Language Recognition (SLR) is an essential yet challenging task sin...
research
03/28/2018

Exploiting Recurrent Neural Networks and Leap Motion Controller for Sign Language and Semaphoric Gesture Recognition

In human interactions, hands are a powerful way of expressing informatio...
research
06/02/2023

EdGCon: Auto-assigner of Iconicity Ratings Grounded by Lexical Properties to Aid in Generation of Technical Gestures

Gestures that share similarities in their forms and are related in their...
research
10/23/2020

Position and Rotation Invariant Sign Language Recognition from 3D Point Cloud Data with Recurrent Neural Networks

Sign language is a gesture based symbolic communication medium among spe...
research
02/10/2015

Avatar-independent scripting for real-time gesture animation

When animation of a humanoid figure is to be generated at run-time, inst...

Please sign up or login with your details

Forgot password? Click here to reset