Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer

by   Shivani Kumar, et al.

Efficient discovery of emotion states of speakers in a multi-party conversation is highly important to design human-like conversational agents. During the conversation, the cognitive state of a speaker often alters due to certain past utterances, which may lead to a flip in her emotion state. Therefore, discovering the reasons (triggers) behind one's emotion flip during conversation is important to explain the emotion labels of individual utterances. In this paper, along with addressing the task of emotion recognition in conversations (ERC), we introduce a novel task – Emotion Flip Reasoning (EFR) that aims to identify past utterances which have triggered one's emotion state to flip at a certain time. We propose a masked memory network to address the former and a Transformer-based network for the latter task. To this end, we consider MELD, a benchmark emotion recognition dataset in multi-party conversations for the task of ERC and augment it with new ground-truth labels for EFR. An extensive comparison with four state-of-the-art models suggests improved performances of our models for both the tasks. We further present anecdotal evidences and both qualitative and quantitative error analyses to support the superiority of our models compared to the baselines.


page 1

page 2

page 3

page 4


CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation

As the use of interactive machines grow, the task of Emotion Recognition...

Understanding Emotion Valence is a Joint Deep Learning Task

The valence analysis of speakers' utterances or written posts helps to u...

DialogueRNN: An Attentive RNN for Emotion Detection in Conversations

Emotion detection in conversations is a necessary step for a number of a...

Generic Dependency Modeling for Multi-Party Conversation

To model the dependencies between utterances in multi-party conversation...

M2R2: Missing-Modality Robust emotion Recognition framework with iterative data augmentation

This paper deals with the utterance-level modalities missing problem wit...

Affective Reasoning at Utterance Level in Conversations: A Causal Discovery Approach

The affective reasoning task is a set of emerging affect-based tasks in ...

Emotion Dynamics Modeling via BERT

Emotion dynamics modeling is a significant task in emotion recognition i...

Please sign up or login with your details

Forgot password? Click here to reset