research
∙
03/13/2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
The high computational and memory requirements of large language model (...
share
research
∙
02/11/2022
The Benefit of Hindsight: Tracing Edge-Cases in Distributed Systems
Today's distributed tracing frameworks only trace a small fraction of al...
research
∙
05/20/2021
Dual-side Sparse Tensor Core
Leveraging sparsity in deep neural network (DNN) models is promising for...
research
∙
11/29/2019