research
∙
03/24/2022
Multi-armed bandits for online optimization of language model pre-training: the use case of dynamic masking
Transformer-based language models (TLMs) provide state-of-the-art perfor...
share
research
∙
09/27/2021
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer
Pivot-based neural machine translation (NMT) is commonly used in low-res...
research
∙
09/27/2021
Integrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer
Complex natural language applications such as speech translation or pivo...
research
∙
08/23/2021
Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches
The Bidirectional Encoder Representations from Transformers (BERT) model...
research
∙
08/20/2019
Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent
Stochastic Gradient Descent (SGD) methods are prominent for training mac...
research
∙
07/27/2017
Sequential Inverse Approximation of a Regularized Sample Covariance Matrix
One of the goals in scaling sequential machine learning methods pertains...
research
∙
07/19/2017