DeepAI
Log In Sign Up

Detecting Interlocutor Confusion in Situated Human-Avatar Dialogue: A Pilot Study

06/06/2022
by   Na Li, et al.
0

In order to enhance levels of engagement with conversational systems, our long term research goal seeks to monitor the confusion state of a user and adapt dialogue policies in response to such user confusion states. To this end, in this paper, we present our initial research centred on a user-avatar dialogue scenario that we have developed to study the manifestation of confusion and in the long term its mitigation. We present a new definition of confusion that is particularly tailored to the requirements of intelligent conversational system development for task-oriented dialogue. We also present the details of our Wizard-of-Oz based data collection scenario wherein users interacted with a conversational avatar and were presented with stimuli that were in some cases designed to invoke a confused state in the user. Post study analysis of this data is also presented. Here, three pre-trained deep learning models were deployed to estimate base emotion, head pose and eye gaze. Despite a small pilot study group, our analysis demonstrates a significant relationship between these indicators and confusion states. We understand this as a useful step forward in the automated analysis of the pragmatics of dialogue.

READ FULL TEXT

page 4

page 5

11/01/2019

DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

We present a large, tunable neural conversational response generation mo...
12/21/2021

Task-oriented Dialogue Systems: performance vs. quality-optima, a review

Task-oriented dialogue systems (TODS) are continuing to rise in populari...
09/26/2019

Towards a Metric for Automated Conversational Dialogue System Evaluation and Improvement

We present "AutoJudge", an automated evaluation method for conversationa...
07/22/2019

SlugBot: Developing a Computational Model andFramework of a Novel Dialogue Genre

One of the most interesting aspects of the Amazon Alexa Prize competitio...
02/16/2020

A Multimodal Dialogue System for Conversational Image Editing

In this paper, we present a multimodal dialogue system for Conversationa...
05/08/2021

Comprehensive Study: How the Context Information of Different Granularity Affects Dialogue State Tracking?

Dialogue state tracking (DST) plays a key role in task-oriented dialogue...