DeepAI AI Chat
Log In Sign Up

Echo-aware Adaptation of Sound Event Localization and Detection in Unknown Environments

by   Masahiro Yasuda, et al.

Our goal is to develop a sound event localization and detection (SELD) system that works robustly in unknown environments. A SELD system trained on known environment data is degraded in an unknown environment due to environmental effects such as reverberation and noise not contained in the training data. Previous studies on related tasks have shown that domain adaptation methods are effective when data on the environment in which the system will be used is available even without labels. However adaptation to unknown environments remains a difficult task. In this study, we propose echo-aware feature refinement (EAR) for SELD, which suppresses environmental effects at the feature level by using additional spatial cues of the unknown environment obtained through measuring acoustic echoes. FOA-MEIR, an impulse response dataset containing over 100 environments, was recorded to validate the proposed method. Experiments on FOA-MEIR show that the EAR effectively improves SELD performance in unknown environments.


page 1

page 2

page 3

page 4


VOICe: A Sound Event Detection Dataset For Generalizable Domain Adaptation

The performance of sound event detection methods can significantly degra...

What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis

Sound event localization and detection (SELD) is an emerging research to...

Ensemble of Discriminators for Domain Adaptation in Multiple Sound Source 2D Localization

This paper introduces an ensemble of discriminators that improves the ac...

Domain Curiosity: Learning Efficient Data Collection Strategies for Domain Adaptation

Domain adaptation is a common problem in robotics, with applications suc...

Room adaptive conditioning method for sound event classification in reverberant environments

Ensuring performance robustness for a variety of situations that can occ...

Few-Shot Sound Source Distance Estimation Using Relation Networks

In this paper, we study the performance of few-shot learning, specifical...