Automatic Hand Sign Recognition: Identify Unusuality through Latent Cognizance

10/29/2021
by   Pisit Nakjai, et al.
0

Sign language is a main communication channel among hearing disability community. Automatic sign language transcription could facilitate better communication and understanding between hearing disability community and hearing majority. As a recent work in automatic sign language transcription has discussed, effectively handling or identifying a non-sign posture is one of the key issues. A non-sign posture is a posture unintended for sign reading and does not belong to any valid sign. A non-sign posture may arise during sign transition or simply from an unaware posture. Confidence ratio has been proposed to mitigate the issue. Confidence ratio is simple to compute and readily available without extra training. However, confidence ratio is reported to only partially address the problem. In addition, confidence ratio formulation is susceptible to computational instability. This article proposes alternative formulations to confidence ratio, investigates an issue of non-sign identification for Thai Finger Spelling recognition, explores potential solutions and has found a promising direction. Not only does this finding address the issue of non-sign identification, it also provide some insight behind a well-learned inference machine, revealing hidden meaning and new interpretation of the underlying mechanism. Our proposed methods are evaluated and shown to be effective for non-sign detection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2023

Improving Sign Recognition with Phonology

We use insights from research on American Sign Language (ASL) phonology ...
research
07/20/2020

Novel Approach to Use HU Moments with Image Processing Techniques for Real Time Sign Language Communication

Sign language is the fundamental communication method among people who s...
research
10/29/2021

Latent Cognizance: What Machine Really Learns

Despite overwhelming achievements in recognition accuracy, extending an ...
research
03/29/2021

Sign Language Production: A Review

Sign Language is the dominant yet non-primary form of communication lang...
research
01/05/2022

All You Need In Sign Language Production

Sign Language is the dominant form of communication language used in the...
research
10/08/2020

Watch, read and lookup: learning to spot signs from multiple supervisors

The focus of this work is sign spotting - given a video of an isolated s...
research
01/10/2022

TFS Recognition: Investigating MPH]Thai Finger Spelling Recognition: Investigating MediaPipe Hands Potentials

Thai Finger Spelling (TFS) sign recognition could benefit a community of...

Please sign up or login with your details

Forgot password? Click here to reset