Extending DNN-based Multiplicative Masking to Deep Subband Filtering for Improved Dereverberation

03/01/2023
by   Jean-Marie Lemercier, et al.
0

In this paper, we present a scheme for extending deep neural network-based multiplicative maskers to deep subband filters for speech restoration in the time-frequency domain. The resulting method can be generically applied to any deep neural network providing masks in the time-frequency domain, while requiring only few more trainable parameters and a computational overhead that is negligible for state-of-the-art neural networks. We demonstrate that the resulting deep subband filtering scheme outperforms multiplicative masking for dereverberation, while leaving the denoising performance virtually the same. We argue that this is because deep subband filtering in the time-frequency domain fits the subband approximation often assumed in the dereverberation literature, whereas multiplicative masking corresponds to the narrowband approximation generally employed in denoising.

READ FULL TEXT
research
03/05/2023

Time-frequency Network for Robust Speaker Recognition

The wide deployment of speech-based biometric systems usually demands hi...
research
10/22/2022

Speech Emotion Recognition via an Attentive Time-Frequency Neural Network

Spectrogram is commonly used as the input feature of deep neural network...
research
11/06/2020

Deep Learning-based Cattle Activity Classification Using Joint Time-frequency Data Representation

Automated cattle activity classification allows herders to continuously ...
research
04/17/2019

Deep Filtering: Signal Extraction Using Complex Time-Frequency Filters

Signal extraction from a single-channel mixture with additional undesire...
research
07/21/2021

Composite Time-Frequency Analysis and Siamese Neural Network based Compound Interference Identification for Hopping Frequency System

In a hostile environment, interference identification plays an important...
research
04/16/2019

Audio Denoising with Deep Network Priors

We present a method for audio denoising that combines processing done in...
research
07/25/2023

Fitting Auditory Filterbanks with Multiresolution Neural Networks

Waveform-based deep learning faces a dilemma between nonparametric and p...

Please sign up or login with your details

Forgot password? Click here to reset