Shaohuai Shi

is this you? claim profile

0 followers
Hong Kong Baptist University

Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans

The COVID-19 pandemic has spread globally for several months. Because it...
01/14/2021 ∙ by Xin He, et al. ∙ 0 ∙ share

read it
Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

Distributed training techniques have been widely deployed in large-scale...
10/20/2020 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

Multiplication of a sparse matrix to a dense matrix (SpDM) is widely use...
05/29/2020 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges

In recent years, distributed deep learning techniques are widely deploye...
05/27/2020 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
FADNet: A Fast and Accurate Network for Disparity Estimation

Deep neural networks (DNNs) have achieved great success in the area of c...
03/24/2020 ∙ by Qiang Wang, et al. ∙ 13 ∙ share

read it
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey

Distributed deep learning becomes very common to reduce the overall trai...
03/10/2020 ∙ by Zhenheng Tang, et al. ∙ 0 ∙ share

read it
Communication Contention Aware Scheduling of Multiple Deep Learning Training Jobs

Distributed Deep Learning (DDL) has rapidly grown its popularity since i...
02/24/2020 ∙ by Qiang Wang, et al. ∙ 0 ∙ share

read it
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection

Distributed learning techniques such as federated learning have enabled ...
02/22/2020 ∙ by Zhenheng Tang, et al. ∙ 0 ∙ share

read it
MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning

Distributed synchronous stochastic gradient descent has been widely used...
12/18/2019 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Understanding Top-k Sparsification in Distributed Deep Learning

Distributed stochastic gradient descent (SGD) algorithms are widely depl...
11/20/2019 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees

To reduce the long training time of large deep neural network (DNN) mode...
11/20/2019 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models

Skin disease is one of the most common types of human diseases, which ma...
11/20/2019 ∙ by Xin He, et al. ∙ 18 ∙ share

read it
Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Deep neural networks (DNNs) have become widely used in many AI applicati...
09/15/2019 ∙ by Yuxin Wang, et al. ∙ 0 ∙ share

read it
A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

Distributed synchronous stochastic gradient descent (S-SGD) with data pa...
01/14/2019 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms

Distributed synchronous stochastic gradient descent has been widely used...
11/27/2018 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes

Synchronized stochastic gradient descent (SGD) optimizers with data para...
07/30/2018 ∙ by Xianyan Jia, et al. ∙ 0 ∙ share

read it
Modeling and Evaluation of Synchronous Stochastic Gradient Descent in Distributed Deep Learning on Multiple GPUs

With huge amounts of training data, deep learning has made great breakth...
05/10/2018 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs

Deep learning frameworks have been widely deployed on GPU servers for de...
11/16/2017 ∙ by Shaohuai Shi, et al. ∙ 0 ∙ share

read it
Performance Evaluation of Deep Learning Tools in Docker Containers

With the success of deep learning techniques in a broad range of applica...
11/09/2017 ∙ by Pengfei Xu, et al. ∙ 0 ∙ share

read it

Shaohuai Shi

Featured Co-authors

Wei Wang

Bo Li

Yan Zhang

Xin Liu

Zhibo Chen

Xiaoming Liu

Bo Yang

Qiang Wang

Xiaowen Chu

Pengfei Xu

Wei He

Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans

Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

Efficient Sparse-Dense Matrix-Matrix Multiplication on GPUs Using the Customized Sparse Storage Format

Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges

FADNet: A Fast and Accurate Network for Disparity Estimation

Communication-Efficient Distributed Deep Learning: A Comprehensive Survey

Communication Contention Aware Scheduling of Multiple Deep Learning Training Jobs

Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection

MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning

Understanding Top-k Sparsification in Distributed Deep Learning

Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees

Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms

Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes

Modeling and Evaluation of Synchronous Stochastic Gradient Descent in Distributed Deep Learning on Multiple GPUs

Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs

Performance Evaluation of Deep Learning Tools in Docker Containers