BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation

01/17/2023
by   Xiangyu Qin, et al.
12

Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual information and dialogue structure information among the extracted features. However, we discover that this paradigm has several limitations. Accordingly, we propose a novel paradigm, i.e., exploring contextual information and dialogue structure information in the fine-tuning step, and adapting the PLM to the ERC task in terms of input text, classification structure, and training strategy. Furthermore, we develop our model BERT-ERC according to the proposed paradigm, which improves ERC performance in three aspects, namely suggestive text, fine-grained classification module, and two-stage training. Compared to existing methods, BERT-ERC achieves substantial improvement on four datasets, indicating its effectiveness and generalization capability. Besides, we also set up the limited resources scenario and the online prediction scenario to approximate real-world scenarios. Extensive experiments demonstrate that the proposed paradigm significantly outperforms the previous one and can be adapted to various scenes.

READ FULL TEXT
research
07/27/2022

Contextual Information and Commonsense Based Prompt for Emotion Recognition in Conversation

Emotion recognition in conversation (ERC) aims to detect the emotion for...
research
06/27/2019

EmotionX-KU: BERT-Max based Contextual Emotion Classifier

We propose a contextual emotion classifier based on a transferable langu...
research
10/12/2021

Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition

While wav2vec 2.0 has been proposed for speech recognition (ASR), it can...
research
08/15/2020

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition

Multimodal emotion recognition from speech is an important area in affec...
research
09/21/2023

InstructERC: Reforming Emotion Recognition in Conversation with a Retrieval Multi-task LLMs Framework

The development of emotion recognition in dialogue (ERC) has been consis...
research
08/12/2023

Simple Model Also Works: A Novel Emotion Recognition Network in Textual Conversation Based on Curriculum Learning Strategy

Emotion Recognition in Conversation (ERC) has emerged as a research hots...
research
07/02/2023

A Dual-Stream Recurrence-Attention Network with Global-Local Awareness for Emotion Recognition in Textual Dialogue

In real-world dialogue systems, the ability to understand the user's emo...

Please sign up or login with your details

Forgot password? Click here to reset