Transfer Learning for Personality Perception via Speech Emotion Recognition

05/25/2023
by   Yuanchao Li, et al.
0

Holistic perception of affective attributes is an important human perceptual ability. However, this ability is far from being realized in current affective computing, as not all of the attributes are well studied and their interrelationships are poorly understood. In this work, we investigate the relationship between two affective attributes: personality and emotion, from a transfer learning perspective. Specifically, we transfer Transformer-based and wav2vec2-based emotion recognition models to perceive personality from speech across corpora. Compared with previous studies, our results show that transferring emotion recognition is effective for personality perception. Moreoever, this allows for better use and exploration of small personality corpora. We also provide novel findings on the relationship between personality and emotion that will aid future research on holistic affect recognition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2018

Cross Corpus Speech Emotion Classificaiton - An Effective Transfer Learning Technique

Cross-corpus speech emotion recognition can be a useful transfer learnin...
research
01/19/2018

Cross Corpus Speech Emotion Classification- An Effective Transfer Learning Technique

Cross-corpus speech emotion recognition can be a useful transfer learnin...
research
11/11/2018

Improving speech emotion recognition via Transformer-based Predictive Coding through transfer learning

Speech emotion recognition is an important aspect of human-computer inte...
research
10/24/2019

Detecting gender differences in perception of emotion in crowdsourced data

Do men and women perceive emotions differently? Popular convictions plac...
research
03/14/2022

Audiovisual Affect Assessment and Autonomous Automobiles: Applications

Emotion and a broader range of affective driver states can be a life dec...
research
10/24/2019

Unsupervised Representation Learning with Future Observation Prediction for Speech Emotion Recognition

Prior works on speech emotion recognition utilize various unsupervised l...
research
04/03/2023

Designing and Evaluating Speech Emotion Recognition Systems: A reality check case study with IEMOCAP

There is an imminent need for guidelines and standard test sets to allow...

Please sign up or login with your details

Forgot password? Click here to reset