research
∙
03/24/2023
Scaling Expert Language Models with Unsupervised Domain Discovery
Large language models are typically trained densely: all parameters are ...
share
research
∙
08/05/2022
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models
We present Branch-Train-Merge (BTM), a communication-efficient algorithm...
research
∙
07/26/2021
Don't Sweep your Learning Rate under the Rug: A Closer Look at Cross-modal Transfer of Pretrained Transformers
Self-supervised pre-training of large-scale transformer models on text c...
research
∙
10/14/2020
Recipes for Safety in Open-domain Chatbots
Models trained on large unlabeled corpora of human interactions will lea...
research
∙
10/01/2020
How to Motivate Your Dragon: Teaching Goal-Driven Agents to Speak and Act in Fantasy Worlds
We seek to create agents that both act and communicate with other agents...
research
∙
06/22/2020
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
We present our view of what is necessary to build an engaging open-domai...
research
∙
02/07/2020
I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-oriented dialogue agents
Dialogue research tends to distinguish between chit-chat and goal-orient...
research
∙
02/07/2020
I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-orientated dialogue agents
Dialogue research tends to distinguish between chit-chat and goal-orient...
research
∙
11/10/2019
Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training
Generative dialogue models currently suffer from a number of problems wh...
research
∙
09/06/2019
ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons
While dialogue remains an important end-goal of natural language researc...
research
∙
11/01/2018