A basic gesture and motion format for virtual reality multisensory applications

by   Annie Luciani, et al.

The question of encoding movements such as those produced by human gestures may become central in the coming years, given the growing importance of movement data exchanges between heterogeneous systems and applications (musical applications, 3D motion control, virtual reality interaction, etc.). For the past 20 years, various formats have been proposed for encoding movement, especially gestures. Though, these formats, at different degrees, were designed in the context of quite specific applications (character animation, motion capture, musical gesture, biomechanical concerns...). The article introduce a new file format, called GMS (for 'Gesture and Motion Signal'), with the aim of being more low-level and generic, by defining the minimal features a format carrying movement/gesture information needs, rather than by gathering all the information generally given by the existing formats. The article argues that, given its growing presence in virtual reality situations, the "gesture signal" itself must be encoded, and that a specific format is needed. The proposed format features the inner properties of such signals: dimensionality, structural features, types of variables, and spatial and temporal properties. The article first reviews the various situations with multisensory virtual objects in which gesture controls intervene. The proposed format is then deduced, as a mean to encode such versatile and variable "gestural and animated scene".


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


Comparing Controller With the Hand Gestures Pinch and Grab for Picking Up and Placing Virtual Objects

Grabbing virtual objects is one of the essential tasks for Augmented, Vi...

Acoustic Sensing-based Hand Gesture Detection for Wearable Device Interaction

Hand gesture recognition attracts great attention for interaction since ...

Creative Action at a Distance: A Conceptual Framework for Embodied Performance With Robotic Actors

Acting, stand-up and dancing are creative, embodied performances that no...

Avatar-independent scripting for real-time gesture animation

When animation of a humanoid figure is to be generated at run-time, inst...

Holoscopic 3D Micro-Gesture Database for Wearable Device Interaction

With the rapid development of augmented reality (AR) and virtual reality...

SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational Agents

Non-verbal behavior is essential for embodied agents like social robots,...

Moving to Communicate, Moving to Interact: Patterns of Body Motion in Musical Duo Performance

Skilled ensemble musicians coordinate with high precision, even when imp...