-
ZeRO-Offload: Democratizing Billion-Scale Model Training
Large-scale model training has been a playing ground for a limited few r...
01/18/2021 ∙ by Jie Ren, et al. ∙
0
∙
share
read it
-
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping
Recently, Transformer-based language models have demonstrated remarkable...
10/26/2020 ∙ by Minjia Zhang, et al. ∙
0
∙
share
read it
-
LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory
The effectiveness of LSTM neural networks for popular tasks such as Auto...
11/04/2019 ∙ by Reza Yazdani, et al. ∙
76
∙
share
read it
-
Sentinel: Runtime Data Management on Heterogeneous Main MemorySystems for Deep Learning
Software-managed heterogeneous memory (HM) provides a promising solution...
09/11/2019 ∙ by Jie Ren, et al. ∙
0
∙
share
read it
-
Zoom: SSD-based Vector Search for Optimizing Accuracy, Latency and Memory
With the advancement of machine learning and deep learning, vector searc...
09/11/2018 ∙ by Minjia Zhang, et al. ∙
0
∙
share
read it
-
Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
Neural language models (NLMs) have recently gained a renewed interest by...
06/11/2018 ∙ by Minjia Zhang, et al. ∙
0
∙
share
read it
