Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

10/05/2020
by   Jean-Benoit Delbrouck, et al.
0

This paper aims to bring a new lightweight yet powerful solution for the task of Emotion Recognition and Sentiment Analysis. Our motivation is to propose two architectures based on Transformers and modulation that combine the linguistic and acoustic inputs from a wide range of datasets to challenge, and sometimes surpass, the state-of-the-art in the field. To demonstrate the efficiency of our models, we carefully evaluate their performances on the IEMOCAP, MOSI, MOSEI and MELD dataset. The experiments can be directly replicated and the code is fully open for future researches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

09/07/2020

Is Everything Fine, Grandma? Acoustic and Linguistic Modeling for Robust Elderly Speech Emotion Recognition

Acoustic and linguistic analysis for elderly emotion recognition is an u...
06/29/2020

A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis

Understanding expressed sentiment and emotions are two crucial factors i...
04/05/2021

Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA

This paper investigates how Natural Language Understanding (NLU) could b...
04/08/2022

Transformer-Based Self-Supervised Learning for Emotion Recognition

In order to exploit representations of time-series signals, such as phys...
10/08/2018

DepecheMood++: a Bilingual Emotion Lexicon Built Through Simple Yet Powerful Techniques

Several lexica for sentiment analysis have been developed and made avail...
09/17/2021

Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis

The importance and pervasiveness of emotions in our lives makes affectiv...
12/15/2020

Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution

Hateful meme detection is a new research area recently brought out that ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.