research
∙
02/14/2023
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation
State-of-the-art language generation models can degenerate when applied ...
share
research
∙
08/05/2022
Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback
Frozen models trained to mimic static datasets can never improve their p...
research
∙
08/05/2022
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
We present BlenderBot 3, a 175B parameter dialogue model capable of open...
research
∙
06/15/2022
DIRECTOR: Generator-Classifiers For Supervised Language Modeling
Current language models achieve low perplexity but their resulting gener...
research
∙
04/03/2022
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation
Current language generation models suffer from issues such as repetition...
research
∙
04/01/2016
A Compositional Approach to Language Modeling
Traditional language models treat language as a finite state automaton o...
research
∙
01/03/2016