DeepAI
Log In Sign Up

What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis

07/22/2021
by   Thi Ngoc Tho Nguyen, et al.
0

Sound event localization and detection (SELD) is an emerging research topic that aims to unify the tasks of sound event detection and direction-of-arrival estimation. As a result, SELD inherits the challenges of both tasks, such as noise, reverberation, interference, polyphony, and non-stationarity of sound sources. Furthermore, SELD often faces an additional challenge of assigning correct correspondences between the detected sound classes and directions of arrival to multiple overlapping sound events. Previous studies have shown that unknown interferences in reverberant environments often cause major degradation in the performance of SELD systems. To further understand the challenges of the SELD task, we performed a detailed error analysis on two of our SELD systems, which both ranked second in the team category of DCASE SELD Challenge, one in 2020 and one in 2021. Experimental results indicate polyphony as the main challenge in SELD, due to the difficulty in detecting all sound events of interest. In addition, the SELD systems tend to make fewer errors for the polyphonic scenario that is dominant in the training set.

READ FULL TEXT
11/26/2019

A two-step system for sound event localization and detection

Sound event detection and sound event localization requires different fe...
09/30/2020

Event-Independent Network for Polyphonic Sound Event Localization and Detection

Polyphonic sound event localization and detection is not only detecting ...
02/18/2022

Echo-aware Adaptation of Sound Event Localization and Detection in Unknown Environments

Our goal is to develop a sound event localization and detection (SELD) s...
10/01/2021

SALSA: Spatial Cue-Augmented Log-Spectrogram Features for Polyphonic Sound Event Localization and Detection

Sound event localization and detection (SELD) consists of two subtasks, ...
07/14/2022

Few-shot bioacoustic event detection at the DCASE 2022 challenge

Few-shot sound event detection is the task of detecting sound events, de...
02/03/2022

A benchmark of state-of-the-art sound event detection systems evaluated on synthetic soundscapes

This paper proposes a benchmark of submissions to Detection and Classifi...
10/29/2021

Differentiable Tracking-Based Training of Deep Learning Sound Source Localizers

Data-based and learning-based sound source localization (SSL) has shown ...