Deep Learning-Based Joint Control of Acoustic Echo Cancellation, Beamforming and Postfiltering

03/03/2022
by   Thomas Haubner, et al.
0

We introduce a novel method for controlling the functionality of a hands-free speech communication device which comprises a model-based acoustic echo canceller (AEC), minimum variance distortionless response (MVDR) beamformer (BF) and spectral postfilter (PF). While the AEC removes the early echo component, the MVDR BF and PF suppress the residual echo and background noise. As key innovation, we suggest to use a single deep neural network (DNN) to jointly control the adaptation of the various algorithmic components. This allows for rapid convergence and high steady-state performance in the presence of high-level interfering double-talk. End-to-end training of the DNN using a time-domain speech extraction loss function avoids the design of individual control strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2021

End-To-End Deep Learning-Based Adaptation Control for Frequency-Domain Adaptive System Identification

We present a novel end-to-end deep learning-based adaptation control alg...
research
06/18/2019

Cascaded Cross-Module Residual Learning towards Lightweight End-to-End Speech Coding

Speech codecs learn compact representations of speech signals to facilit...
research
05/17/2019

End-to-end Adaptation with Backpropagation through WFST for On-device Speech Recognition System

An on-device DNN-HMM speech recognition system efficiently works with a ...
research
11/09/2021

Joint AEC AND Beamforming with Double-Talk Detection using RNN-Transformer

Acoustic echo cancellation (AEC) is a technique used in full-duplex comm...
research
05/23/2020

Exploring Optimal DNN Architecture for End-to-End Beamformers Based on Time-frequency References

Acoustic beamformers have been widely used to enhance audio signals. Cur...
research
09/25/2018

An Exploration of Mimic Architectures for Residual Network Based Spectral Mapping

Spectral mapping uses a deep neural network (DNN) to map directly from n...
research
11/08/2021

Learning Filterbanks for End-to-End Acoustic Beamforming

Recent work on monaural source separation has shown that performance can...

Please sign up or login with your details

Forgot password? Click here to reset