Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

04/28/2023
by   Mallikharjuna Rao K, et al.
0

People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most of the general population cannot understand this language, creating a communication barrier, especially in places such as banks, airports, supermarkets, etc. [1]. A sign language recognition(SLR) system is a must to solve this problem. The main focus of this model is to develop a real-time word-level sign language recognition system that would translate sign language to text. Much research has been done on ASL(American sign language). Thus, we have worked on ISL(Indian sign language) to cater to the needs of the deaf and hard-of-hearing community of India[2]. In this research, we provide an Indian Sign Language-based Sign Language recognition system. For this analysis, the user must be able to take pictures of hand movements using a web camera, and the system must anticipate and display the name of the taken picture. The acquired image goes through several processing phases, some of which use computer vision techniques, including grayscale conversion, dilatation, and masking. Our model is trained using a convolutional neural network (CNN), which is then utilized to recognize the images. Our best model has a 99 rate[3].

READ FULL TEXT

page 4

page 5

page 6

page 12

page 13

research
01/05/2022

Sign Language Recognition System using TensorFlow Object Detection API

Communication is defined as the act of sharing or exchanging information...
research
07/20/2020

Novel Approach to Use HU Moments with Image Processing Techniques for Real Time Sign Language Communication

Sign language is the fundamental communication method among people who s...
research
01/17/2019

Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech

Recent advancements in the field of computer vision with the help of dee...
research
07/28/2021

Egyptian Sign Language Recognition Using CNN and LSTM

Sign language is a set of gestures that deaf people use to communicate. ...
research
12/01/2022

Multilingual Communication System with Deaf Individuals Utilizing Natural and Visual Languages

According to the World Federation of the Deaf, more than two hundred sig...
research
11/01/2021

Sign-to-Speech Model for Sign Language Understanding: A Case Study of Nigerian Sign Language

Through this paper, we seek to reduce the communication barrier between ...
research
01/12/2010

A Topological derivative based image segmentation for sign language recognition system using isotropic filter

The need of sign language is increasing radically especially to hearing ...

Please sign up or login with your details

Forgot password? Click here to reset