research
∙
09/05/2023
nanoT5: A PyTorch Framework for Pre-training and Fine-tuning T5-style Models with Limited Resources
State-of-the-art language models like T5 have revolutionized the NLP lan...
share
research
∙
07/12/2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
The computation necessary for training Transformer-based language models...
research
∙
11/17/2022
Efficient Transformers with Dynamic Token Pooling
Transformers achieve unrivalled performance in modelling language, but r...
research
∙
10/26/2021
