research
∙
09/13/2023
Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
Most interpretability research in NLP focuses on understanding the behav...
share
research
∙
08/18/2023
Latent State Models of Training Dynamics
The impact of randomness on model training is poorly understood. How do ...
research
∙
05/23/2023
Two Failures of Self-Consistency in the Multi-Step Reasoning of LLMs
Large language models (LLMs) have achieved widespread success on a varie...
research
∙
03/28/2023
Training Language Models with Language Feedback at Scale
Pretrained language models often generate outputs that are not in line w...
research
∙
03/28/2023
Improving Code Generation by Training with Natural Language Feedback
The potential for pre-trained large language models (LLMs) to use natura...
research
∙
02/28/2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search
Given the recent impressive accomplishments of language models (LMs) for...
research
∙
02/16/2023
Pretraining Language Models with Human Preferences
Language models (LMs) are pretrained to imitate internet text, including...
research
∙
08/26/2022
What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
We present the results of the NLP Community Metasurvey. Run from May to ...
research
∙
05/23/2022
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way
Summarization datasets are often assembled either by scraping naturally ...
research
∙
05/02/2022
Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection
In modern interactive speech-based systems, speech is consumed and trans...
research
∙
04/29/2022
Training Language Models with Natural Language Feedback
Pretrained language models often do not perform tasks in ways that are i...
research
∙
04/11/2022
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Current QA systems can generate reasonable-sounding yet false answers wi...
research
∙
12/16/2021
QuALITY: Question Answering with Long Input Texts, Yes!
To enable building and testing models on long-document comprehension, we...
research
∙
11/16/2021
Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair
More capable language models increasingly saturate existing task benchma...
research
∙
10/15/2021
BBQ: A Hand-Built Bias Benchmark for Question Answering
It is well documented that NLP models learn social biases present in the...
research
∙
05/21/2019