Communication-Cost Aware Microphone Selection For Neural Speech Enhancement with Ad-hoc Microphone Arrays

11/14/2020
by   Jonah Casebeer, et al.
0

When performing multi-channel speech enhancement with a wireless acoustic sensor network, streaming information from all sensors can be prohibitive in terms of communication costs. However, not all sensors will be necessary to achieve good performance, which presents an opportunity to reduce communication costs. We propose a data-driven technique to leverage these opportunities by jointly learning a speech enhancement and data-request neural network. Our model is trained with a task-performance/communication-cost trade off. While working within the trade off, our method can intelligently stream from more microphones in lower SNR scenes and fewer microphones in higher SNR scenes. We evaluate the model in a complex echoic acoustic scene with moving sources and show that it matches the performance of a baseline model while streaming less data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2021

Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

Speech enhancement promises higher efficiency in ad-hoc microphone array...
research
07/31/2023

SAMbA: Speech enhancement with Asynchronous ad-hoc Microphone Arrays

Speech enhancement in ad-hoc microphone arrays is often hindered by the ...
research
12/23/2017

A Low-Cost Robust Distributed Linearly Constrained Beamformer for Wireless Acoustic Sensor Networks with Arbitrary Topology

We propose a new robust distributed linearly constrained beamformer (BF)...
research
05/29/2020

SNR-based teachers-student technique for speech enhancement

It is very challenging for speech enhancement methods to achieves robust...
research
03/03/2020

Phonetic Feedback for Speech Enhancement With and Without Parallel Speech Data

While deep learning systems have gained significant ground in speech enh...
research
06/14/2021

F-T-LSTM based Complex Network for Joint Acoustic Echo Cancellation and Speech Enhancement

With the increasing demand for audio communication and online conference...
research
08/17/2020

Efficient Low-Latency Speech Enhancement with Mobile Audio Streaming Networks

We propose Mobile Audio Streaming Networks (MASnet) for efficient low-la...

Please sign up or login with your details

Forgot password? Click here to reset