From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue

08/24/2023
by   Shutong Feng, et al.
0

Emotion recognition in conversations (ERC) is a crucial task for building human-like conversational agents. While substantial efforts have been devoted to ERC for chit-chat dialogues, the task-oriented counterpart is largely left unattended. Directly applying chit-chat ERC models to task-oriented dialogues (ToDs) results in suboptimal performance as these models overlook key features such as the correlation between emotions and task completion in ToDs. In this paper, we propose a framework that turns a chit-chat ERC model into a task-oriented one, addressing three critical aspects: data, features and objective. First, we devise two ways of augmenting rare emotions to improve ERC performance. Second, we use dialogue states as auxiliary features to incorporate key information from the goal of the user. Lastly, we leverage a multi-aspect emotion definition in ToDs to devise a multi-task learning objective and a novel emotion-distance weighted loss function. Our framework yields significant improvements for a range of chit-chat ERC models on EmoWOZ, a large-scale dataset for user emotion in ToDs. We further investigate the generalisability of the best resulting model to predict user satisfaction in different ToD datasets. A comparison with supervised baselines shows a strong zero-shot capability, highlighting the potential usage of our framework in wider scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2021

EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion in Task-Oriented Dialogue Systems

The ability to recognise emotions lends a conversational artificial inte...
research
11/16/2015

Heterogeneous Knowledge Transfer in Video Emotion Recognition, Attribution and Summarization

Emotional content is a key element in user-generated videos. However, it...
research
05/24/2022

Building a Dialogue Corpus Annotated with Expressed and Experienced Emotions

In communication, a human would recognize the emotion of an interlocutor...
research
12/21/2021

Contrast and Generation Make BART a Good Dialogue Emotion Recognizer

In dialogue systems, utterances with similar semantics may have distinct...
research
10/11/2021

Cross Domain Emotion Recognition using Few Shot Knowledge Transfer

Emotion recognition from text is a challenging task due to diverse emoti...
research
09/21/2023

InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework

The development of emotion recognition in dialogue (ERC) has been consis...
research
11/16/2022

Deep Emotion Recognition in Textual Conversations: A Survey

While Emotion Recognition in Conversations (ERC) has seen a tremendous a...

Please sign up or login with your details

Forgot password? Click here to reset