research
∙
08/26/2022
What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
We present the results of the NLP Community Metasurvey. Run from May to ...
share
research
∙
05/23/2022
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way
Summarization datasets are often assembled either by scraping naturally ...
research
∙
03/24/2022
Token Dropping for Efficient BERT Pretraining
Transformer-based models generally allocate the same amount of computati...
research
∙
12/16/2021
Amortized Noisy Channel Neural Machine Translation
Noisy channel models have been especially effective in neural machine tr...
research
∙
12/16/2021
QuALITY: Question Answering with Long Input Texts, Yes!
To enable building and testing models on long-document comprehension, we...
research
∙
06/04/2021
AgreeSum: Agreement-Oriented Multi-Document Summarization
We aim to renew interest in a particular multi-document summarization (M...
research
∙
06/01/2021
Comparing Test Sets with Item Response Theory
Recent years have seen numerous NLP datasets introduced to evaluate the ...
research
∙
09/16/2020
Text Generation by Learning from Off-Policy Demonstrations
Current approaches to text generation largely rely on autoregressive mod...
research
∙
05/02/2020
ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
We propose to train a non-autoregressive machine translation model to mi...
research
∙
05/01/2020
Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?
While pretrained models such as BERT have shown large gains across natur...
research
∙
02/06/2020
Consistency of a Recurrent Language Model With Respect to Incomplete Decoding
Despite strong performance on a variety of tasks, neural sequence models...
research
∙
11/07/2019
Improving Joint Training of Inference Networks and Structured Prediction Energy Networks
Deep energy-based models are powerful, but pose challenges for learning ...
research
∙
10/09/2019