Modeling Global Body Configurations in American Sign Language

09/03/2020
by   Nicholas Wilkins, et al.
0

American Sign Language (ASL) is the fourth most commonly used language in the United States and is the language most commonly used by Deaf people in the United States and the English-speaking regions of Canada. Unfortunately, until recently, ASL received little research. This is due, in part, to its delayed recognition as a language until William C. Stokoe's publication in 1960. Limited data has been a long-standing obstacle to ASL research and computational modeling. The lack of large-scale datasets has prohibited many modern machine-learning techniques, such as Neural Machine Translation, from being applied to ASL. In addition, the modality required to capture sign language (i.e. video) is complex in natural settings (as one must deal with background noise, motion blur, and the curse of dimensionality). Finally, when compared with spoken languages, such as English, there has been limited research conducted into the linguistics of ASL. We realize a simplified version of Liddell and Johnson's Movement-Hold (MH) Model using a Probabilistic Graphical Model (PGM). We trained our model on ASLing, a dataset collected from three fluent ASL signers. We evaluate our PGM against other models to determine its ability to model ASL. Finally, we interpret various aspects of the PGM and draw conclusions about ASL phonetics. The main contributions of this paper are

READ FULL TEXT
research
12/22/2020

Speak with signs: Active learning platform for Greek Sign Language, English Sign Language, and their translation

Sign Language is used to facilitate the communication between Deaf and n...
research
04/22/2022

Keypoint based Sign Language Translation without Glosses

Sign Language Translation (SLT) is a task that has not been studied rela...
research
09/01/2022

Topic Detection in Continuous Sign Language Videos

Significant progress has been made recently on challenging tasks in auto...
research
05/21/2020

Improving American Sign Language Recognition with Synthetic Data

There is a need for real-time communication between the deaf and hearing...
research
01/10/2017

Bidirectional American Sign Language to English Translation

We outline a bidirectional translation system that converts sentences fr...
research
10/13/2022

SDW-ASL: A Dynamic System to Generate Large Scale Dataset for Continuous American Sign Language

Despite tremendous progress in natural language processing using deep le...
research
10/29/2021

Latent Cognizance: What Machine Really Learns

Despite overwhelming achievements in recognition accuracy, extending an ...

Please sign up or login with your details

Forgot password? Click here to reset