Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer

03/23/2021
by   Shivani Kumar, et al.
0

Efficient discovery of emotion states of speakers in a multi-party conversation is highly important to design human-like conversational agents. During the conversation, the cognitive state of a speaker often alters due to certain past utterances, which may lead to a flip in her emotion state. Therefore, discovering the reasons (triggers) behind one's emotion flip during conversation is important to explain the emotion labels of individual utterances. In this paper, along with addressing the task of emotion recognition in conversations (ERC), we introduce a novel task – Emotion Flip Reasoning (EFR) that aims to identify past utterances which have triggered one's emotion state to flip at a certain time. We propose a masked memory network to address the former and a Transformer-based network for the latter task. To this end, we consider MELD, a benchmark emotion recognition dataset in multi-party conversations for the task of ERC and augment it with new ground-truth labels for EFR. An extensive comparison with four state-of-the-art models suggests improved performances of our models for both the tasks. We further present anecdotal evidences and both qualitative and quantitative error analyses to support the superiority of our models compared to the baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/26/2021

CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation

As the use of interactive machines grow, the task of Emotion Recognition...
research
05/27/2023

Understanding Emotion Valence is a Joint Deep Learning Task

The valence analysis of speakers' utterances or written posts helps to u...
research
11/01/2018

DialogueRNN: An Attentive RNN for Emotion Detection in Conversations

Emotion detection in conversations is a necessary step for a number of a...
research
02/21/2023

Generic Dependency Modeling for Multi-Party Conversation

To model the dependencies between utterances in multi-party conversation...
research
05/05/2022

M2R2: Missing-Modality Robust emotion Recognition framework with iterative data augmentation

This paper deals with the utterance-level modalities missing problem wit...
research
05/04/2023

Affective Reasoning at Utterance Level in Conversations: A Causal Discovery Approach

The affective reasoning task is a set of emerging affect-based tasks in ...
research
04/15/2021

Emotion Dynamics Modeling via BERT

Emotion dynamics modeling is a significant task in emotion recognition i...

Please sign up or login with your details

Forgot password? Click here to reset