research
∙
07/05/2023
SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inference
Autoregressive large language models (LLMs) have made remarkable progres...
share
research
∙
05/03/2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training
Modern Natural Language Generation (NLG) models come with massive comput...
research
∙
10/16/2021
