Jiarui Fang | DeepAI

AI Chat

Featured Co-authors

Jie Zhou
349 publications
Yang Yu
155 publications
Cho-Jui Hsieh
147 publications
Yang You
66 publications
Jin Liu
61 publications
Yongbin Li
53 publications
Yuliang Liu
36 publications
Ziming Liu
33 publications
Guangwen Yang
16 publications
Haohuan Fu
10 publications
Conghui He
9 publications

∙ 02/06/2023

Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

In recent years, large-scale models have demonstrated state-of-the-art p...

0 Yuliang Liu, et al. ∙

∙ 12/10/2022

Elixir: Train a Large Language Model on a Small GPU Cluster

In recent years, the number of parameters of one deep learning (DL) mode...

0 Haichen Huang, et al. ∙

∙ 09/06/2022

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Large transformer models display promising performance on a wide range o...

0 Jiangsu Du, et al. ∙

∙ 08/08/2022

A Frequency-aware Software Cache for Large Recommendation System Embeddings

Deep learning recommendation models (DLRMs) have been widely applied in ...

0 Jiarui Fang, et al. ∙

∙ 08/12/2021

PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

The pre-trained model (PTM) is revolutionizing Artificial intelligence (...

0 Jiarui Fang, et al. ∙

∙ 10/09/2020

TurboTransformers: An Efficient GPU Serving System For Transformer Models

The transformer is the most critical algorithm innovation of the Nature ...

0 Jiarui Fang, et al. ∙

∙ 03/16/2019

swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

This paper reports our efforts on swCaffe, a highly efficient parallel f...

0 Jiarui Fang, et al. ∙

∙ 08/13/2018

RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

Data parallelism has already become a dominant method to scale Deep Neur...

0 Jiarui Fang, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world