Single-channel speech enhancement by using psychoacoustical model inspired fusion framework

02/10/2022
by   Suman Samui, et al.
0

When the parameters of Bayesian Short-time Spectral Amplitude (STSA) estimator for speech enhancement are selected based on the characteristics of the human auditory system, the gain function of the estimator becomes more flexible. Although this type of estimator in acoustic domain is quite effective in reducing the back-ground noise at high frequencies, it produces more speech distortions, which make the high-frequency contents of the speech such as friciatives less perceptible in heavy noise conditions, resulting in intelligibility reduction. On the other hand, the speech enhancement scheme, which exploits the psychoacoustic evidence of frequency selectivity in the modulation domain, is found to be able to increase the intelligibility of noisy speech by a substantial amount, but also suffers from the temporal slurring problem due to its essential design constraint. In order to achieve the joint improvements in both the perceived speech quality and intelligibility, we proposed and investigated a fusion framework by combining the merits of acoustic and modulation domain approaches while avoiding their respective weaknesses. Objective measure evaluation shows that the proposed speech enhancement fusion framework can provide consistent improvements in the perceived speech quality and intelligibility across different SNR levels in various noise conditions, while compared to the other baseline techniques.

READ FULL TEXT

page 1

page 5

research
02/16/2023

TAPLoss: A Temporal Acoustic Parameter Loss for Speech Enhancement

Speech enhancement models have greatly progressed in recent years, but s...
research
02/10/2022

Auditory Model based Phase-Aware Bayesian Spectral Amplitude Estimator for Single-Channel Speech Enhancement

Bayesian estimation of short-time spectral amplitude is one of the most ...
research
05/18/2022

Dictionary-Based Fusion of Contact and Acoustic Microphones for Wind Noise Reduction

In mobile speech communication applications, wind noise can lead to a se...
research
07/09/2017

Model-Based Speech Enhancement in the Modulation Domain

This paper presents algorithms for modulation-domain speech enhancement ...
research
02/16/2023

PAAPLoss: A Phonetic-Aligned Acoustic Parameter Loss for Speech Enhancement

Despite rapid advancement in recent years, current speech enhancement mo...
research
12/10/2018

An individualized super Gaussian single microphone Speech Enhancement for hearing aid users with smartphone as an assistive device

In this letter, we derive a new super Gaussian Joint Maximum a Posterior...
research
11/02/2021

CycleGAN with Dual Adversarial Loss for Bone-Conducted Speech Enhancement

Compared with air-conducted speech, bone-conducted speech has the unique...

Please sign up or login with your details

Forgot password? Click here to reset