DeepAI AI Chat
Log In Sign Up

I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

03/01/2023
by   Yuanchao Li, et al.
ATR
Kyoto University
Monash University
0

Current Spoken Dialogue Systems (SDSs) often serve as passive listeners that respond only after receiving user speech. To achieve human-like dialogue, we propose a novel future prediction architecture that allows an SDS to anticipate future affective reactions based on its current behaviors before the user speaks. In this work, we investigate two scenarios: speech and laughter. In speech, we propose to predict the user's future emotion based on its temporal relationship with the system's current emotion and its causal relationship with the system's current Dialogue Act (DA). In laughter, we propose to predict the occurrence and type of the user's laughter using the system's laughter behaviors in the current turn. Preliminary analysis of human-robot dialogue demonstrated synchronicity in the emotions and laughter displayed by the human and robot, as well as DA-emotion causality in their dialogue. This verifies that our architecture can contribute to the development of an anticipatory SDS.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/13/2018

Studying Mutual Phonetic Influence with a Web-Based Spoken Dialogue System

This paper presents a study on mutual speech variation influences in a h...
03/10/2017

Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue

Our overall program objective is to provide more natural ways for soldie...
12/01/2019

Talking with Robots: Opportunities and Challenges

Notwithstanding the tremendous progress that is taking place in spoken l...
12/07/2022

Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue

Entrainment is the phenomenon by which an interlocutor adapts their spea...
10/23/2018

Stepwise Acquisition of Dialogue Act Through Human-Robot Interaction

A dialogue act (DA) represents the meaning of an utterance at the illocu...
07/12/2018

An Affective Robot Companion for Assisting the Elderly in a Cognitive Game Scenario

Being able to recognize emotions in human users is considered a highly d...