Deep Reinforcement Learning with Pre-training for Time-efficient Training of Automatic Speech Recognition

05/21/2020
by   Thejan Rajapakshe, et al.
0

Deep reinforcement learning (deep RL) is a combination of deep learning with reinforcement learning principles to create efficient methods that can learn by interacting with its environment. This has led to breakthroughs in many complex tasks, such as playing the game "Go", that were previously difficult to solve. However, deep RL requires significant training time making it difficult to use in various real-life applications such as Human-Computer Interaction (HCI). In this paper, we study pre-training in deep RL to reduce the training time and improve the performance of Speech Recognition, a popular application of HCI. To evaluate the performance improvement in training we use the publicly available "Speech Command" dataset, which contains utterances of 30 command keywords spoken by 2,618 speakers. Results show that pre-training with deep RL offers faster convergence compared to non-pre-trained RL while achieving improved speech recognition accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2019

Pre-training in Deep Reinforcement Learning for Automatic Speech Recognition

Deep reinforcement learning (deep RL) is a combination of deep learning ...
research
01/04/2021

A novel policy for pre-trained Deep Reinforcement Learning for Speech Emotion Recognition

Reinforcement Learning (RL) is a semi-supervised learning paradigm which...
research
09/12/2017

Pre-training Neural Networks with Human Demonstrations for Deep Reinforcement Learning

Deep reinforcement learning (deep RL) has achieved superior performance ...
research
12/23/2018

Parallelized Interactive Machine Learning on Autonomous Vehicles

Deep reinforcement learning (deep RL) has achieved superior performance ...
research
11/21/2021

Experience-Enhanced Learning: One Size Still does not Fit All in Automatic Database

Recent years, the database committee has attempted to develop automatic ...
research
11/19/2021

Fast and Data-Efficient Training of Rainbow: an Experimental Study on Atari

Across the Arcade Learning Environment, Rainbow achieves a level of perf...
research
02/16/2021

Training Larger Networks for Deep Reinforcement Learning

The success of deep learning in the computer vision and natural language...

Please sign up or login with your details

Forgot password? Click here to reset