Log In Sign Up

Real-time Indian Sign Language (ISL) Recognition

by   Kartik Shenoy, et al.

This paper presents a system which can recognise hand poses gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired and the rest of the society. The existing solutions either provide relatively low accuracy or do not work in real-time. This system provides good results on both the parameters. It can identify 33 hand poses and some gestures from the ISL. Sign Language is captured from a smartphone camera and its frames are transmitted to a remote server for processing. The use of any external hardware (such as gloves or the Microsoft Kinect sensor) is avoided, making it user-friendly. Techniques such as Face detection, Object stabilisation and Skin Colour Segmentation are used for hand detection and tracking. The image is further subjected to a Grid-based Feature Extraction technique which represents the hand's pose in the form of a Feature Vector. Hand poses are then classified using the k-Nearest Neighbours algorithm. On the other hand, for gesture classification, the motion and intermediate hand poses observation sequences are fed to Hidden Markov Model chains corresponding to the 12 pre-selected gestures defined in ISL. Using this methodology, the system is able to achieve an accuracy of 99.7 gesture recognition.


page 1

page 3

page 4

page 6

page 7

page 8


Real-Time and Robust Method for Hand Gesture Recognition System Based on Cross-Correlation Coefficient

Hand gesture recognition possesses extensive applications in virtual rea...

Real-time Recognition of Yoga Poses using computer Vision for Smart Health Care

Nowadays, yoga has become a part of life for many people. Exercises and ...

Online interpretation of numeric sign language using 2-d skeletal model

Gesturing is one of the natural modes of human communication. Signs prod...

SHREC 2022 Track on Online Detection of Heterogeneous Gestures

This paper presents the outcomes of a contest organized to evaluate meth...

Activity Detection from Wearable Electromyogram Sensors using Hidden Markov Model

Surface electromyography (sEMG) has gained significant importance during...

Statistical and Spatio-temporal Hand Gesture Features for Sign Language Recognition using the Leap Motion Sensor

In modern society, people should not be identified based on their disabi...

A novel shape matching descriptor for real-time hand gesture recognition

The current state-of-the-art hand gesture recognition methodologies heav...