DeepAI AI Chat
Log In Sign Up

Ensemble of Discriminators for Domain Adaptation in Multiple Sound Source 2D Localization

by   Guillaume Le Moing, et al.

This paper introduces an ensemble of discriminators that improves the accuracy of a domain adaptation technique for the localization of multiple sound sources. Recently, deep neural networks have led to promising results for this task, yet they require a large amount of labeled data for training. Recording and labeling such datasets is very costly, especially because data needs to be diverse enough to cover different acoustic conditions. In this paper, we leverage acoustic simulators to inexpensively generate labeled training samples. However, models trained on synthetic data tend to perform poorly with real-world recordings due to the domain mismatch. For this, we explore two domain adaptation methods using adversarial learning for sound source localization which use labeled synthetic data and unlabeled real data. We propose a novel ensemble approach that combines discriminators applied at different feature levels of the localization model. Experiments show that our ensemble discrimination method significantly improves the localization performance without requiring any label from the real data.


page 1

page 2

page 3

page 4


Data-Efficient Framework for Real-world Multiple Sound Source 2D Localization

Deep neural networks have recently led to promising results for the task...

Adversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation

Deep learning techniques have been widely used in autonomous driving sys...

PieTrack: An MOT solution based on synthetic data training and self-supervised domain adaptation

In order to cope with the increasing demand for labeling data and privac...

Domain Adaptation Using Adversarial Learning for Autonomous Navigation

Autonomous navigation has become an increasingly popular machine learnin...

Beyond Photo Realism for Domain Adaptation from Synthetic Data

As synthetic imagery is used more frequently in training deep models, it...

Echo-aware Adaptation of Sound Event Localization and Detection in Unknown Environments

Our goal is to develop a sound event localization and detection (SELD) s...

DeepFont: Identify Your Font from An Image

As font is one of the core design concepts, automatic font identificatio...