research
∙
04/15/2021
Hierarchical Learning for Generation with Long Source Sequences
One of the challenges for current sequence to sequence (seq2seq) models ...
share
research
∙
04/28/2020
Recipes for building an open-domain chatbot
Building open-domain chatbots is a challenging area for machine learning...
research
∙
01/22/2020
Multilingual Denoising Pre-training for Neural Machine Translation
This paper demonstrates that multilingual denoising pre-training produce...
research
∙
10/29/2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
We present BART, a denoising autoencoder for pretraining sequence-to-seq...
research
∙
07/26/2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Language model pretraining has led to significant performance gains but ...
research
∙
07/24/2019
SpanBERT: Improving Pre-training by Representing and Predicting Spans
We present SpanBERT, a pre-training method that is designed to better re...
research
∙
04/19/2019
Constant-Time Machine Translation with Conditional Masked Language Models
Most machine translation systems generate text autoregressively, by sequ...
research
∙
03/19/2019