Open Source HamNoSys Parser for Multilingual Sign Language Encoding

04/14/2022
by   Sylwia Majchrowska, et al.
0

This paper presents our recent developments in the field of automatic processing of sign language corpora using the Hamburg Sign Language Annotation System (HamNoSys). We designed an automated tool to convert HamNoSys annotations into numerical labels for defined initial features of body and hand positions. Our proposed numerical multilabels greatly simplify the structure of HamNoSys annotation without significant loss of gloss meaning. These numerical multilabels can potentially be used to feed the machine learning models, which would accelerate the development of vision-based sign language recognition. In addition, this tool can assist experts in the annotation process to help identify semantic errors. The code and sample annotations are publicly available at https://github.com/hearai/parse-hamnosys.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/29/2023

Bornil: An open-source sign language data crowdsourcing platform for AI enabled dialect-agnostic communication

The absence of annotated sign language datasets has hindered the develop...
research
04/07/2021

GrammarTagger: A Multilingual, Minimally-Supervised Grammar Profiler for Language Education

We present GrammarTagger, an open-source grammar profiler which, given a...
research
08/04/2022

Automatic dense annotation of large-vocabulary sign language videos

Recently, sign language researchers have turned to sign language interpr...
research
05/16/2023

ADDSL: Hand Gesture Detection and Sign Language Recognition on Annotated Danish Sign Language

For a long time, detecting hand gestures and recognizing them as letters...
research
08/31/2022

Audiogram Digitization Tool for Audiological Reports

A number of private and public insurers compensate workers whose hearing...
research
05/21/2022

Unsupervised Sign Language Phoneme Clustering using HamNoSys Notation

Traditionally, sign language resources have been collected in controlled...
research
10/20/2020

American Sign Language Identification Using Hand Trackpoint Analysis

Sign Language helps people with Speaking and Hearing Disabilities commun...

Please sign up or login with your details

Forgot password? Click here to reset