SkipConvNet: Skip Convolutional Neural Network for Speech Dereverberation using Optimally Smoothed Spectral Mapping

07/17/2020
by   Vinay Kothapally, et al.
0

The reliability of using fully convolutional networks (FCNs) has been successfully demonstrated by recent studies in many speech applications. One of the most popular variants of these FCNs is the `U-Net', which is an encoder-decoder network with skip connections. In this study, we propose `SkipConvNet' where we replace each skip connection with multiple convolutional modules to provide decoder with intuitive feature maps rather than encoder's output to improve the learning capacity of the network. We also propose the use of optimal smoothing of power spectral density (PSD) as a pre-processing step, which helps to further enhance the efficiency of the network. To evaluate our proposed system, we use the REVERB challenge corpus to assess the performance of various enhancement approaches under the same conditions. We focus solely on monitoring improvements in speech quality and their contribution to improving the efficiency of back-end speech systems, such as speech recognition and speaker verification, trained on only clean speech. Experimental findings show that the proposed system consistently outperforms other approaches.

READ FULL TEXT

page 2

page 3

research
03/22/2018

Speech Dereverberation Using Fully Convolutional Networks

Speech derverberation using a single microphone is addressed in this pap...
research
10/05/2021

Late reverberation suppression using U-nets

In real-world settings, speech signals are almost always affected by rev...
research
04/12/2021

Complex Spectral Mapping With Attention Based Convolution Recurrent Neural Network for Speech Enhancement

Speech enhancement has benefited from the success of deep learning in te...
research
10/15/2020

Deep Convolutional Neural Network-based Inverse Filtering Approach for Speech De-reverberation

In this paper, we introduce a spectral-domain inverse filtering approach...
research
04/14/2018

Select, Attend, and Transfer: Light, Learnable Skip Connections

Skip connections in deep networks have improved both segmentation and cl...
research
03/26/2018

Spectral feature mapping with mimic loss for robust speech recognition

For the task of speech enhancement, local learning objectives are agnost...
research
09/25/2018

An Exploration of Mimic Architectures for Residual Network Based Spectral Mapping

Spectral mapping uses a deep neural network (DNN) to map directly from n...

Please sign up or login with your details

Forgot password? Click here to reset