research
∙
07/06/2023
Read, Look or Listen? What's Needed for Solving a Multimodal Dataset
The prevalence of large-scale multimodal datasets presents unique challe...
share
research
∙
08/31/2022
Efficient Methods for Natural Language Processing: A Survey
Getting the most out of limited resources allows advances in natural lan...
research
∙
10/19/2020
Parameter Norm Growth During Training of Transformers
The capacity of neural networks like the widely adopted transformer is k...
research
∙
05/13/2020
A Mixture of h-1 Heads is Better than h Heads
Multi-head attentive neural architectures have achieved state-of-the-art...
research
∙
04/18/2020
A Formal Hierarchy of RNN Architectures
We develop a formal hierarchy of the expressive capacity of RNN architec...
research
∙
02/15/2020
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
Fine-tuning pretrained contextual word embedding models to supervised do...
research
∙
07/22/2019
Green AI
The computations required for deep learning research have been doubling ...
research
∙
04/25/2018
