Deep neural network Based Low-latency Speech Separation with Asymmetric analysis-Synthesis Window Pair

06/22/2021
by   Shanshan Wang, et al.
0

Time-frequency masking or spectrum prediction computed via short symmetric windows are commonly used in low-latency deep neural network (DNN) based source separation. In this paper, we propose the usage of an asymmetric analysis-synthesis window pair which allows for training with targets with better frequency resolution, while retaining the low-latency during inference suitable for real-time speech enhancement or assisted hearing applications. In order to assess our approach across various model types and datasets, we evaluate it with both speaker-independent deep clustering (DC) model and a speaker-dependent mask inference (MI) model. We report an improvement in separation performance of up to 1.5 dB in terms of source-to-distortion ratio (SDR) while maintaining an algorithmic latency of 8 ms.

READ FULL TEXT
research
02/19/2019

Low-Latency Deep Clustering For Speech Separation

This paper proposes a low algorithmic latency adaptation of the deep clu...
research
07/18/2018

Deep neural network based speech separation optimizing an objective estimator of intelligibility for low latency applications

Mean square error (MSE) has been the preferred choice as loss function i...
research
05/08/2019

Universal Sound Separation

Recent deep learning approaches have achieved impressive performance on ...
research
06/29/2016

Optimising The Input Window Alignment in CD-DNN Based Phoneme Recognition for Low Latency Processing

We present a systematic analysis on the performance of a phonetic recogn...
research
04/12/2022

Low Latency Time Domain Multichannel Speech and Music Source Separation

The Goal is to obtain a simple multichannel source separation with very ...
research
09/18/2020

X-DC: Explainable Deep Clustering based on Learnable Spectrogram Templates

Deep neural networks (DNNs) have achieved substantial predictive perform...
research
09/21/2021

Low-latency NuMI Trigger for the CHIPS-5 Neutrino Detector

The CHIPS R D project aims to develop affordable water Cherenkov detec...

Please sign up or login with your details

Forgot password? Click here to reset