Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

06/15/2021
by   Nicolas Furnon, et al.
0

Speech enhancement promises higher efficiency in ad-hoc microphone arrays than in constrained microphone arrays thanks to the wide spatial coverage of the devices in the acoustic scene. However, speech enhancement in ad-hoc microphone arrays still raises many challenges. In particular, the algorithms should be able to handle a variable number of microphones, as some devices in the array might appear or disappear. In this paper, we propose a solution that can efficiently process the spatial information captured by the different devices of the microphone array, while being robust to a link failure. To do this, we use an attention mechanism in order to put more weight on the relevant signals sent throughout the array and to neglect the redundant or empty channels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2023

SAMbA: Speech enhancement with Asynchronous ad-hoc Microphone Arrays

Speech enhancement in ad-hoc microphone arrays is often hindered by the ...
research
05/02/2022

A Meeting Transcription System for an Ad-Hoc Acoustic Sensor Network

We propose a system that transcribes the conversation of a typical meeti...
research
11/14/2020

Communication-Cost Aware Microphone Selection For Neural Speech Enhancement with Ad-hoc Microphone Arrays

When performing multi-channel speech enhancement with a wireless acousti...
research
02/13/2020

DNN-Based Distributed Multichannel Mask Estimation for Speech Enhancement in Microphone Arrays

Multichannel processing is widely used for speech enhancement but severa...
research
10/22/2021

TADRN: Triple-Attentive Dual-Recurrent Network for Ad-hoc Array Multichannel Speech Enhancement

Deep neural networks (DNNs) have been successfully used for multichannel...
research
11/07/2020

Enhancement by postfiltering for speech and audio coding in ad-hoc sensor networks

Enhancement algorithms for wireless acoustics sensor networks (WASNs) ar...
research
06/25/2020

Will Dynamic Arrays finally change the way Models are built?

Spreadsheets offer a supremely successful and intuitive means of process...

Please sign up or login with your details

Forgot password? Click here to reset