DNN-based Source Enhancement to Increase Objective Sound Quality Assessment Score

10/22/2018
by   Yuma Koizumi, et al.
0

We propose a training method for deep neural network (DNN)-based source enhancement to increase objective sound quality assessment (OSQA) scores such as the perceptual evaluation of speech quality (PESQ). In many conventional studies, DNNs have been used as a mapping function to estimate time-frequency masks and trained to minimize an analytically tractable objective function such as the mean squared error (MSE). Since OSQA scores have been used widely for sound-quality evaluation, constructing DNNs to increase OSQA scores would be better than using the minimum-MSE to create high-quality output signals. However, since most OSQA scores are not analytically tractable, i.e., they are black boxes, the gradient of the objective function cannot be calculated by simply applying back-propagation. To calculate the gradient of the OSQA-based objective function, we formulated a DNN optimization scheme on the basis of black-box optimization, which is used for training a computer that plays a game. For a black-box-optimization scheme, we adopt the policy gradient method for calculating the gradient on the basis of a sampling algorithm. To simulate output signals using the sampling algorithm, DNNs are used to estimate the probability density function of the output signals that maximize OSQA scores. The OSQA scores are calculated from the simulated output signals, and the DNNs are trained to increase the probability of generating the simulated output signals that achieve high OSQA scores. Through several experiments, we found that OSQA scores significantly increased by applying the proposed method, even though the MSE was not minimized.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

page 11

page 12

research
02/14/2020

Stable Training of DNN for Speech Enhancement based on Perceptually-Motivated Black-Box Cost Function

Improving subjective sound quality of enhanced signals is one of the mos...
research
05/19/2023

Computational models of sound-quality metrics using method for calculating loudness with gammatone/gammachirp auditory filterbank

Sound-quality metrics (SQMs), such as sharpness, roughness, and fluctuat...
research
03/21/2019

Data-driven design of perfect reconstruction filterbank for DNN-based sound source enhancement

We propose a data-driven design method of perfect-reconstruction filterb...
research
06/15/2018

Monaural source enhancement maximizing source-to-distortion ratio via automatic differentiation

Recently, deep neural network (DNN) has made a breakthrough in monaural ...
research
02/20/2022

The Loop Game: Quality Assessment and Optimization for Low-Light Image Enhancement

There is an increasing consensus that the design and optimization of low...
research
10/27/2021

RoMA: Robust Model Adaptation for Offline Model-based Optimization

We consider the problem of searching an input maximizing a black-box obj...
research
09/15/2022

Bidirectional Learning for Offline Infinite-width Model-based Optimization

In offline model-based optimization, we strive to maximize a black-box o...

Please sign up or login with your details

Forgot password? Click here to reset