Efficiency Evaluation of Character-level RNN Training Schedules

05/09/2016

∙

We present four training and prediction schedules from the same character-level recurrent neural network. The efficiency of these schedules is tested in terms of model effectiveness as a function of training time and amount of training data seen. We show that the choice of training and prediction schedule potentially has a considerable impact on the prediction effectiveness for a given training budget.

READ FULL TEXT

Efficiency Evaluation of Character-level RNN Training Schedules

Recurrent neural networks based Indic word-wise script identification using character-wise training

Online Keyword Spotting with a Character-Level Recurrent Neural Network

Character-Level Language Modeling with Hierarchical Recurrent Neural Networks

Character-level Recurrent Neural Networks in Practice: Comparing Training and Sampling Schemes

Authorship Attribution in Bangla literature using Character-level CNN

An Optimized and Energy-Efficient Parallel Implementation of Non-Iteratively Trained Recurrent Neural Networks

Surprisal-Driven Zoneout

Efficiency Evaluation of Character-level RNN Training Schedules

Related Research

Recurrent neural networks based Indic word-wise script identification using character-wise training

Online Keyword Spotting with a Character-Level Recurrent Neural Network

Character-Level Language Modeling with Hierarchical Recurrent Neural Networks

Character-level Recurrent Neural Networks in Practice: Comparing Training and Sampling Schemes

Authorship Attribution in Bangla literature using Character-level CNN

An Optimized and Energy-Efficient Parallel Implementation of Non-Iteratively Trained Recurrent Neural Networks

Surprisal-Driven Zoneout