Indian EmoSpeech Command Dataset: A dataset for emotion based speech recognition in the wild

10/18/2019
by   Subham Banga, et al.
0

Speech emotion analysis is an important task which further enables several application use cases. The non-verbal sounds within speech utterances also play a pivotal role in emotion analysis in speech. Due to the widespread use of smartphones, it becomes viable to analyze speech commands captured using microphones for emotion understanding by utilizing on-device machine learning models. The non-verbal information includes the environment background sounds describing the type of surroundings, current situation and activities being performed. In this work, we consider both verbal (speech commands) and non-verbal sounds (background noises) within an utterance for emotion analysis in real-life scenarios. We create an indigenous dataset for this task namely "Indian EmoSpeech Command Dataset". It contains keywords with diverse emotions and background sounds, presented to explore new challenges in audio analysis. We exhaustively compare with various baseline models for emotion analysis on speech commands on several performance metrics. We demonstrate that we achieve a significant average gain of 3.3 command dataset for keyword spotting.

READ FULL TEXT
research
06/22/2023

Speech Emotion Diarization: Which Emotion Appears When?

Speech Emotion Recognition (SER) typically relies on utterance-level sol...
research
12/26/2021

Bilingual Speech Recognition by Estimating Speaker Geometry from Video Data

Speech recognition is very challenging in student learning environments ...
research
02/11/2021

Language Independent Emotion Quantification using Non linear Modelling of Speech

At present emotion extraction from speech is a very important issue due ...
research
01/21/2023

New Challenges for Content Privacy in Speech and Audio

Privacy in speech and audio has many facets. A particularly under-develo...
research
08/28/2023

Effect of Attention and Self-Supervised Speech Embeddings on Non-Semantic Speech Tasks

Human emotion understanding is pivotal in making conversational technolo...
research
10/24/2019

Detecting gender differences in perception of emotion in crowdsourced data

Do men and women perceive emotions differently? Popular convictions plac...
research
08/16/2020

Computer-Generated Music for Tabletop Role-Playing Games

In this paper we present Bardo Composer, a system to generate background...

Please sign up or login with your details

Forgot password? Click here to reset