research
∙
03/29/2022
Training Compute-Optimal Large Language Models
We investigate the optimal model size and number of tokens for training ...
share
research
∙
02/02/2022
Unified Scaling Laws for Routed Language Models
The performance of a language model has been shown to be effectively mod...
research
∙
12/08/2021
Improving language models by retrieving from trillions of tokens
We enhance auto-regressive language models by conditioning on document c...
research
∙
04/13/2021
Podracer architectures for scalable Reinforcement Learning
Supporting state-of-the-art AI research requires balancing rapid prototy...
research
∙
04/02/2021
Skillful Precipitation Nowcasting using Deep Generative Models of Radar
Precipitation nowcasting, the high-resolution forecasting of precipitati...
research
∙
03/09/2020
Transformation-based Adversarial Video Prediction on Large-Scale Data
Recent breakthroughs in adversarial generative modeling have led to mode...
research
∙
10/13/2019
Stabilizing Transformers for Reinforcement Learning
Owing to their ability to both effectively integrate information over lo...
research
∙
09/26/2019
V-MPO: On-Policy Maximum a Posteriori Policy Optimization for Discrete and Continuous Control
Some of the most successful applications of deep reinforcement learning ...
research
∙
09/25/2019
High Fidelity Speech Synthesis with Adversarial Networks
Generative adversarial networks have seen rapid development in recent ye...
research
∙
07/15/2019
Efficient Video Generation on Complex Datasets
Generative models of natural images have progressed towards high fidelit...
research
∙
02/01/2019