Emotions Beyond Words: Non-Speech Audio Emotion Recognition With Edge Computing

05/01/2023
by   Ibrahim Malik, et al.
0

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies are focused on speech-emotion recognition using complex architectures. In this paper, a non-speech-based emotion recognition system is proposed, which can rely on edge computing to analyse emotions conveyed through non-speech expressions like screaming and crying. In particular, we explore knowledge distillation to design a computationally efficient system that can be deployed on edge devices with limited resources without degrading the performance significantly. We comprehensively evaluate our proposed framework using two publicly available datasets and highlight its effectiveness by comparing the results with the well-known MobileNet model. Our results demonstrate the feasibility and effectiveness of using edge computing for non-speech emotion detection, which can potentially improve applications that rely on emotion detection in communication networks. To the best of our knowledge, this is the first work on an edge-computing-based framework for detecting emotions in non-speech audio, offering promising directions for future research.

READ FULL TEXT

page 4

page 8

research
11/14/2022

Describing emotions with acoustic property prompts for speech emotion recognition

Emotions lie on a broad continuum and treating emotions as a discrete nu...
research
04/16/2018

Multi-Modal Emotion recognition on IEMOCAP Dataset using Deep Learning

Emotion recognition has become an important field of research in Human C...
research
03/31/2021

Privacy Enhanced Speech Emotion Communication using Deep Learning Aided Edge Computing

Speech emotion sensing in communication networks has a wide range of app...
research
10/28/2020

Speech-Based Emotion Recognition using Neural Networks and Information Visualization

Emotions recognition is commonly employed for health assessment. However...
research
01/02/2023

EmoGator: A New Open Source Vocal Burst Dataset with Baseline Machine Learning Classification Methodologies

Vocal Bursts – short, non-speech vocalizations that convey emotions, suc...
research
10/26/2022

Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learning

Speech emotion recognition (SER) has been a popular research topic in hu...
research
06/05/2019

A Sustainable Multi-modal Multi-layer Emotion-aware Service at the Edge

Limited by the computational capabilities and battery energy of terminal...

Please sign up or login with your details

Forgot password? Click here to reset