Neural Network-augmented Kalman Filtering for Robust Online Speech Dereverberation in Noisy Reverberant Environments

04/06/2022
by   Jean-Marie Lemercier, et al.
0

In this paper, a neural network-augmented algorithm for noise-robust online dereverberation with a Kalman filtering variant of the weighted prediction error (WPE) method is proposed. The filter stochastic variations are predicted by a deep neural network (DNN) trained end-to-end using the filter residual error and signal characteristics. The presented framework allows for robust dereverberation on a single-channel noisy reverberant dataset similar to WHAMR!. The Kalman filtering WPE introduces distortions in the enhanced signal when predicting the filter variations from the residual error only, if the target speech power spectral density is not perfectly known and the observation is noisy. The proposed approach avoids these distortions by correcting the filter variations estimation in a data-driven way, increasing the robustness of the method to noisy scenarios. Furthermore, it yields a strong dereverberation and denoising performance compared to a DNN-supported recursive least squares variant of WPE, especially for highly noisy inputs.

READ FULL TEXT
research
08/07/2017

Phase-Aware Single-Channel Speech Enhancement with Modulation-Domain Kalman Filtering

We present a single-channel phase-sensitive speech enhancement algorithm...
research
04/06/2022

Customizable End-to-end Optimization of Online Neural Network-supported Dereverberation for Hearing Devices

This work focuses on online dereverberation for hearing devices using th...
research
04/06/2022

End-To-End Optimization of Online Neural Network-supported Two-Stage Dereverberation for Hearing Devices

A two-stage online dereverberation algorithm for hearing devices is pres...
research
09/17/2018

Uncertainty Propagation in Deep Neural Networks Using Extended Kalman Filtering

Extended Kalman Filtering (EKF) can be used to propagate and quantify in...
research
10/18/2021

Unsupervised Learned Kalman Filtering

In this paper we adapt KalmanNet, which is a recently pro-posed deep neu...
research
07/26/2018

Modulation-Domain Kalman Filtering for Monaural Blind Speech Denoising and Dereverberation

We describe a monaural speech enhancement algorithm based on modulation-...
research
11/12/2019

Recursive Filter for Space-Variant Variance Reduction

We propose a method to reduce non-uniform sample variance to a predeterm...

Please sign up or login with your details

Forgot password? Click here to reset