research
∙
05/24/2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
Despite remarkable advancements in few-shot generalization in natural la...
share
research
∙
05/23/2023
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations
Multilingual sequence-to-sequence models perform poorly with increased l...
research
∙
12/20/2022
On the Role of Parallel Data in Cross-lingual Transfer Learning
While prior work has established that the use of parallel data is conduc...
research
∙
10/30/2022
DiffusER: Discrete Diffusion via Edit-based Reconstruction
In text generation, models that generate text from scratch one token at ...
research
∙
10/13/2022
M2D2: A Massively Multi-domain Language Modeling Dataset
We present M2D2, a fine-grained, massively multi-domain corpus for study...
research
∙
05/24/2022
Learning to Model Editing Processes
Most existing sequence generation models produce outputs in one pass, us...
research
∙
05/24/2022
Large Language Models are Zero-Shot Reasoners
Pretrained large language models (LLMs) are widely used in many sub-fiel...
research
∙
01/28/2022
Can Wikipedia Help Offline Reinforcement Learning?
Fine-tuning reinforcement learning (RL) models has been challenging beca...
research
∙
09/10/2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages
Reproducible benchmarks are crucial in driving progress of machine trans...
research
∙
08/04/2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining
Despite the success of multilingual sequence-to-sequence pretraining, mo...
research
∙
05/18/2021
LEWIS: Levenshtein Editing for Unsupervised Text Style Transfer
Many types of text style transfer can be achieved with only small, preci...
research
∙
01/01/2021
Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers
The advent of the Transformer can arguably be described as a driving for...
research
∙
10/07/2020
VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modeling
In this paper, we tackle the task of definition modeling, where the goal...
research
∙
04/20/2020
Variational Inference for Learning Representations of Natural Language Edits
Document editing has become a pervasive component of production of infor...
research
∙
03/09/2020