research
∙
05/04/2021
Data Augmentation by Concatenation for Low-Resource Translation: A Mystery and a Solution
In this paper, we investigate the driving factors behind concatenation, ...
share
research
∙
03/22/2021
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
With the success of large-scale pre-training and multilingual modeling i...
research
∙
10/31/2019
Pseudolikelihood Reranking with Masked Language Models
We rerank with scores from pretrained masked language models like BERT t...
research
∙
10/14/2019
Transformers without Tears: Improving the Normalization of Self-Attention
We evaluate three simple, normalization-centric changes to improve Trans...
research
∙
10/01/2019
Auto-Sizing the Transformer Network: Improving Speed, Efficiency, and Performance for Low-Resource Machine Translation
Neural sequence-to-sequence models, particularly the Transformer, are th...
research
∙
10/03/2017
Improving Lexical Choice in Neural Machine Translation
We explore two solutions to the problem of mistranslating rare words in ...
research
∙
08/31/2017