Efficient Implementation of the Room Simulator for Training Deep Neural Network Acoustic Models

12/09/2017
by   Chanwoo Kim, et al.
0

In this paper, we describe how to efficiently implement an acoustic room simulator to generate large-scale simulated data for training deep neural networks. Even though Google Room Simulator in [1] was shown to be quite effective in reducing the Word Error Rates (WERs) for far-field applications by generating simulated far-field training sets, it requires a very large number of Fast Fourier Transforms (FFTs) of large size. Room Simulator in [1] used approximately 80 percent of Central Processing Unit (CPU) usage in our CPU + Graphics Processing Unit (GPU) training architecture [2]. In this work, we implement an efficient OverLap Addition (OLA) based filtering using the open-source FFTW3 library. Further, we investigate the effects of the Room Impulse Response (RIR) lengths. Experimentally, we conclude that we can cut the tail portions of RIRs whose power is less than 20 dB below the maximum power without sacrificing the speech recognition accuracy. However, we observe that cutting RIR tail more than this threshold harms the speech recognition accuracy for rerecorded test sets. Using these approaches, we were able to reduce CPU usage for the room simulator portion down to 9.69 percent in CPU/GPU training architecture. Profiling result shows that we obtain 22.4 times speed-up on a single machine and 37.3 times speed up on Google's distributed training infrastructure.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/07/2021

FAST-RIR: Fast neural diffuse room impulse response generator

We present a neural-network-based fast diffuse room impulse response gen...
10/26/2018

gpuRIR: A python library for Room Impulse Response simulation with GPU acceleration

The Image Source Method (ISM) is one of the most employed techniques to ...
03/31/2021

TS-RIR: Translated synthetic room impulse responses for speech augmentation

We present a method for improving the quality of synthetic room impulse ...
01/30/2018

Accelerating recurrent neural network language model based online speech recognition system

This paper presents methods to accelerate recurrent neural network based...
08/08/2022

FRA-RIR: Fast Random Approximation of the Image-source Method

The training of modern speech processing systems often requires a large ...
06/24/2021

SofaMyRoom: a fast and multiplatform "shoebox" room simulator for binaural room impulse response dataset generation

This paper introduces a shoebox room simulator able to systematically ge...
12/21/2018

Speeding-up the Verification Phase of Set Similarity Joins in the GPGPU paradigm

We investigate the problem of exact set similarity joins using a co-proc...