Multi-Modal Emotion Recognition for Enhanced Requirements Engineering: A Novel Approach

06/02/2023
by   Ben Cheng, et al.
0

Requirements engineering (RE) plays a crucial role in developing software systems by bridging the gap between stakeholders' needs and system specifications. However, effective communication and elicitation of stakeholder requirements can be challenging, as traditional RE methods often overlook emotional cues. This paper introduces a multi-modal emotion recognition platform (MEmoRE) to enhance the requirements engineering process by capturing and analyzing the emotional cues of stakeholders in real-time. MEmoRE leverages state-of-the-art emotion recognition techniques, integrating facial expression, vocal intonation, and textual sentiment analysis to comprehensively understand stakeholder emotions. This multi-modal approach ensures the accurate and timely detection of emotional cues, enabling requirements engineers to tailor their elicitation strategies and improve overall communication with stakeholders. We further intend to employ our platform for later RE stages, such as requirements reviews and usability testing. By integrating multi-modal emotion recognition into requirements engineering, we aim to pave the way for more empathetic, effective, and successful software development processes. We performed a preliminary evaluation of our platform. This paper reports on the platform design, preliminary evaluation, and future development plan as an ongoing project.

READ FULL TEXT

page 1

page 3

page 4

research
09/09/2020

Multi-modal Attention for Speech Emotion Recognition

Emotion represents an essential aspect of human speech that is manifeste...
research
08/18/2021

Emotion Recognition from Multiple Modalities: Fundamentals and Methodologies

Humans are emotional creatures. Multiple modalities are often involved w...
research
03/25/2022

EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition

Emotion recognition in conversation (ERC) aims to analyze the speaker's ...
research
07/21/2021

Multi-modal Residual Perceptron Network for Audio-Video Emotion Recognition

Audio-Video Emotion Recognition is now attacked with Deep Neural Network...
research
04/06/2021

Efficient emotion recognition using hyperdimensional computing with combinatorial channel encoding and cellular automata

In this paper, a hardware-optimized approach to emotion recognition base...
research
06/05/2019

A Sustainable Multi-modal Multi-layer Emotion-aware Service at the Edge

Limited by the computational capabilities and battery energy of terminal...
research
09/09/2021

The Emotional Roller Coaster of Responding to Requirements Changes in Software Engineering

Background: A preliminary study we conducted showed that software practi...

Please sign up or login with your details

Forgot password? Click here to reset