research
∙
03/13/2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
The high computational and memory requirements of large language model (...
share
research
∙
02/26/2020
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers
Since hardware resources are limited, the objective of training deep lea...
research
∙
02/13/2020
Hoplite: Efficient Collective Communication for Task-Based Distributed Systems
Collective communication systems such as MPI offer high performance grou...
research
∙
10/25/2019
Fast Structured Decoding for Sequence Models
Autoregressive sequence models achieve state-of-the-art performance in d...
research
∙
09/15/2019
Hint-Based Training for Non-Autoregressive Machine Translation
Due to the unparallelizable nature of the autoregressive factorization, ...
research
∙
06/06/2019
Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View
The Transformer architecture is widely used in natural language processi...
research
∙
06/08/2018