research
∙
04/17/2021
Competency Problems: On Finding and Removing Artifacts in Language Data
Much recent work in NLP has documented dataset artifacts, bias, and spur...
share
research
∙
12/31/2020
Promoting Graph Awareness in Linearized Graph-to-Text Generation
Generating text from structured inputs, such as meaning representations ...
research
∙
10/19/2020
Parameter Norm Growth During Training of Transformers
The capacity of neural networks like the widely adopted transformer is k...
research
∙
02/15/2020
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
Fine-tuning pretrained contextual word embedding models to supervised do...
research
∙
09/05/2019
Robust Navigation with Language Pretraining and Stochastic Sampling
Core to the vision-and-language navigation (VLN) challenge is building r...
research
∙
02/26/2019
Polyglot Contextual Representations Improve Crosslingual Transfer
We introduce a method to produce multilingual contextual word representa...
research
∙
05/29/2018
Polyglot Semantic Role Labeling
Previous approaches to multilingual semantic dependency parsing treat la...
research
∙
02/07/2017