Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Network

11/20/2019
by   Wenxiang Jiao, et al.
0

Real-time emotion recognition (RTER) in conversations is significant for developing emotionally intelligent chatting machines. Without the future context in RTER, it becomes critical to build the memory bank carefully for capturing historical context and summarize the memories appropriately to retrieve relevant information. We propose an Attention Gated Hierarchical Memory Network (AGHMN) to address the problems of prior work: (1) Commonly used convolutional neural networks (CNNs) for utterance feature extraction are less compatible in the memory modules; (2) Unidirectional gated recurrent units (GRUs) only allow each historical utterance to have context before it, preventing information propagation in the opposite direction; (3) The Soft Attention for summarizing loses the positional and ordering information of memories, regardless of how the memory bank is built. Particularly, we propose a Hierarchical Memory Network (HMN) with a bidirectional GRU (BiGRU) as the utterance reader and a BiGRU fusion layer for the interaction between historical utterances. For memory summarizing, we propose an Attention GRU (AGRU) where we utilize the attention weights to update the internal state of GRU. We further promote the AGRU to a bidirectional variant (BiAGRU) to balance the contextual information from recent memories and that from distant memories. We conduct experiments on two emotion conversation datasets with extensive analysis, demonstrating the efficacy of our AGHMN models.

READ FULL TEXT
research
04/09/2019

HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognition

In this paper, we address three challenges in utterance-level emotion re...
research
04/09/2021

AdCOFE: Advanced Contextual Feature Extraction in Conversations for emotion classification

Emotion recognition in conversations is an important step in various vir...
research
06/11/2023

Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing

Emotion recognition in conversation, which aims to predict the emotion f...
research
10/24/2019

Conversational Emotion Analysis via Attention Mechanisms

Different from the emotion recognition in individual utterances, we prop...
research
01/17/2022

Group Gated Fusion on Attention-based Bidirectional Alignment for Multimodal Emotion Recognition

Emotion recognition is a challenging and actively-studied research area ...
research
06/27/2023

Exploiting Pseudo Future Contexts for Emotion Recognition in Conversations

With the extensive accumulation of conversational data on the Internet, ...
research
04/24/2019

A Self-Attentive Emotion Recognition Network

Modern deep learning approaches have achieved groundbreaking performance...

Please sign up or login with your details

Forgot password? Click here to reset