Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue

03/10/2017
by   Matthew Marge, et al.
0

Our overall program objective is to provide more natural ways for soldiers to interact and communicate with robots, much like how soldiers communicate with other soldiers today. We describe how the Wizard-of-Oz (WOz) method can be applied to multimodal human-robot dialogue in a collaborative exploration task. While the WOz method can help design robot behaviors, traditional approaches place the burden of decisions on a single wizard. In this work, we consider two wizards to stand in for robot navigation and dialogue management software components. The scenario used to elicit data is one in which a human-robot team is tasked with exploring an unknown environment: a human gives verbal instructions from a remote location and the robot follows them, clarifying possible misunderstandings as needed via dialogue. We found the division of labor between wizards to be workable, which holds promise for future software development.

READ FULL TEXT
research
07/21/2018

ScoutBot: A Dialogue System for Collaborative Navigation

ScoutBot is a dialogue interface to physical and simulated robots that s...
research
07/22/2021

Dialogue Object Search

We envision robots that can collaborate and communicate seamlessly with ...
research
07/21/2018

Consequences and Factors of Stylistic Differences in Human-Robot Dialogue

This paper identifies stylistic differences in instruction-giving observ...
research
10/04/2018

Balancing Efficiency and Coverage in Human-Robot Dialogue Collection

We describe a multi-phased Wizard-of-Oz approach to collecting human-rob...
research
03/01/2023

I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

Current Spoken Dialogue Systems (SDSs) often serve as passive listeners ...
research
10/01/2017

A Data-driven Approach Towards Human-robot Collaborative Problem Solving in a Shared Space

We are developing a system for human-robot communication that enables pe...
research
04/18/2022

Gated Multimodal Fusion with Contrastive Learning for Turn-taking Prediction in Human-robot Dialogue

Turn-taking, aiming to decide when the next speaker can start talking, i...

Please sign up or login with your details

Forgot password? Click here to reset