A Review of Temporal Aspects of Hand Gesture Analysis Applied to Discourse Analysis and Natural Conversation

by   Renata Cristina Barros Madeo, et al.

Lately, there has been an increasing interest in hand gesture analysis systems. Recent works have employed pattern recognition techniques and have focused on the development of systems with more natural user interfaces. These systems may use gestures to control interfaces or recognize sign language gestures, which can provide systems with multimodal interaction; or consist in multimodal tools to help psycholinguists to understand new aspects of discourse analysis and to automate laborious tasks. Gestures are characterized by several aspects, mainly by movements and sequence of postures. Since data referring to movements or sequences carry temporal information, this paper presents a literature review about temporal aspects of hand gesture analysis, focusing on applications related to natural conversation and psycholinguistic analysis, using Systematic Literature Review methodology. In our results, we organized works according to type of analysis, methods, highlighting the use of Machine Learning techniques, and applications.


Toward Natural Gesture/Speech Control of a Large Display

In recent years because of the advances in computer vision research, fre...

Sequence-to-Sequence Predictive Model: From Prosody To Communicative Gestures

Communicative gestures and speech prosody are tightly linked. Our object...

Survey on Various Gesture Recognition Techniques for Interfacing Machines Based on Ambient Intelligence

Gesture recognition is mainly apprehensive on analyzing the functionalit...

Generating and Estimating Nonverbal Alphabets for Situated and Multimodal Communications

In this paper, we discuss the formalized approach for generating and est...

SHREC 2022 Track on Online Detection of Heterogeneous Gestures

This paper presents the outcomes of a contest organized to evaluate meth...

Automatized Generation of Alphabets of Symbols

In this paper, we discuss the generation of symbols (and alphabets) base...

Recognizing American Sign Language Nonmanual Signal Grammar Errors in Continuous Videos

As part of the development of an educational tool that can help students...