research
∙
08/08/2022
A Frequency-aware Software Cache for Large Recommendation System Embeddings
Deep learning recommendation models (DLRMs) have been widely applied in ...
share
research
∙
10/28/2021
Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
The Transformer architecture has improved the performance of deep learni...
research
∙
08/08/2021
Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters
Efficient GPU resource scheduling is essential to maximize resource util...
research
∙
05/30/2021
2.5-dimensional distributed model training
Data parallelism does a good job in speeding up the training. However, w...
research
∙
05/30/2021