Towards Generating Virtual Movement from Textual Instructions A Case Study in Quality Assessment

06/06/2020
by   Himangshu Sarma, et al.
0

Many application areas ranging from serious games for health to learning by demonstration in robotics, could benefit from large body movement datasets extracted from textual instructions accompanied by images. The interpretation of instructions for the automatic generation of the corresponding motions (e.g. exercises) and the validation of these movements are difficult tasks. In this article we describe a first step towards achieving automated extraction. We have recorded five different exercises in random order with the help of seven amateur performers using a Kinect. During the recording, we found that the same exercise was interpreted differently by each human performer even though they were given identical textual instructions. We performed a quality assessment study based on that data using a crowdsourcing approach and tested the inter-rater agreement for different types of visualizations, where the RGBbased visualization showed the best agreement among the annotators.

READ FULL TEXT

page 1

page 2

research
05/31/2021

Automating Visualization Quality Assessment: a Case Study in Higher Education

We present a case study in the use of machine+human mixed intelligence f...
research
08/15/2018

Vis4DD: A visualization system that supports Data Quality Visual Assessment

Data quality assessment process is essential to ensure reliable analytic...
research
01/13/2020

Towards Evaluating Plan Generation Approaches with Instructional Texts

Recent research in behaviour understanding through language grounding ha...
research
12/07/2022

Robustness of Learning from Task Instructions

Traditional supervised learning mostly works on individual tasks and req...
research
07/18/2023

Let's ViCE! Mimicking Human Cognitive Behavior in Image Generation Evaluation

Research in Image Generation has recently made significant progress, par...
research
10/08/2019

Executing Instructions in Situated Collaborative Interactions

We study a collaborative scenario where a user not only instructs a syst...

Please sign up or login with your details

Forgot password? Click here to reset