Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

 CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Shaohuai Shi
Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans

Jan 14, 2021
Xin He, Shihao Wang, Xiaowen Chu, Shaohuai Shi, Jiangping Tang, Xin Liu, Chenggang Yan, Jiyong Zhang, Guiguang Ding

* Accepted by AAAI 2021, COVID-19, Neural Architecture Search, AutoML 
  Access Paper or Ask Questions
Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters

Oct 20, 2020
Shaohuai Shi, Xianhao Zhou, Shutao Song, Xingyao Wang, Zilin Zhu, Xue Huang, Xinan Jiang, Feihu Zhou, Zhenyu Guo, Liqiang Xie, Rui Lan, Xianbin Ouyang, Yan Zhang, Jieqian Wei, Jing Gong, Weiliang Lin, Ping Gao, Peng Meng, Xiaomin Xu, Chenyang Guo, Bo Yang, Zhibo Chen, Yongjian Wu, Xiaowen Chu

* 13 pages 
  Access Paper or Ask Questions
Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges

May 27, 2020
Shaohuai Shi, Zhenheng Tang, Xiaowen Chu, Chengjian Liu, Wei Wang, Bo Li

* 10 pages, 6 figures & tables. Code at: https://github.com/HKBU-HPML/ddl-benchmarks 
  Access Paper or Ask Questions
FADNet: A Fast and Accurate Network for Disparity Estimation

Mar 24, 2020
Qiang Wang, Shaohuai Shi, Shizhen Zheng, Kaiyong Zhao, Xiaowen Chu


  Access Paper or Ask Questions
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey

Mar 10, 2020
Zhenheng Tang, Shaohuai Shi, Xiaowen Chu, Wei Wang, Bo Li


  Access Paper or Ask Questions
Communication Contention Aware Scheduling of Multiple Deep Learning Training Jobs

Feb 24, 2020
Qiang Wang, Shaohuai Shi, Canhui Wang, Xiaowen Chu


  Access Paper or Ask Questions
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection

Feb 22, 2020
Zhenheng Tang, Shaohuai Shi, Xiaowen Chu


  Access Paper or Ask Questions
MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning

Dec 18, 2019
Shaohuai Shi, Xiaowen Chu, Bo Li

* Under review as a journal paper. 14 pages. arXiv admin note: substantial text overlap with arXiv:1811.11141 
  Access Paper or Ask Questions
Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees

Nov 21, 2019
Shaohuai Shi, Zhenheng Tang, Qiang Wang, Kaiyong Zhao, Xiaowen Chu

* 11 pages 
  Access Paper or Ask Questions
Understanding Top-k Sparsification in Distributed Deep Learning

Nov 20, 2019
Shaohuai Shi, Xiaowen Chu, Ka Chun Cheung, Simon See

* 14 pages 
  Access Paper or Ask Questions
Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models

Nov 20, 2019
Xin He, Shihao Wang, Shaohuai Shi, Zhenheng Tang, Yuxin Wang, Zhihao Zhao, Jing Dai, Ronghao Ni, Xiaofeng Zhang, Xiaoming Liu, Zhili Wu, Wu Yu, Xiaowen Chu

* KDDBHI Workshop 2019, IEEE BigData Conference 
  Access Paper or Ask Questions
Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Sep 22, 2019
Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

* There are some technical mistakes, and need to be carefully revised. So we choose to withdraw 
  Access Paper or Ask Questions
A Distributed Synchronous SGD Algorithm with Global Top-$k$ Sparsification for Low Bandwidth Networks

Jan 14, 2019
Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu

* 12 pages 
  Access Paper or Ask Questions
Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes

Jul 30, 2018
Xianyan Jia, Shutao Song, Wei He, Yangzihao Wang, Haidong Rong, Feihu Zhou, Liqiang Xie, Zhenyu Guo, Yuanzhou Yang, Liwei Yu, Tiegang Chen, Guangxiao Hu, Shaohuai Shi, Xiaowen Chu

* arXiv admin note: text overlap with arXiv:1803.03383 by other authors 
  Access Paper or Ask Questions
Performance Evaluation of Deep Learning Tools in Docker Containers

Nov 09, 2017
Pengfei Xu, Shaohuai Shi, Xiaowen Chu

* Conference: BIgCom2017, 9 pages 
  Access Paper or Ask Questions
Speeding up Convolutional Neural Networks By Exploiting the Sparsity of Rectifier Units

May 15, 2017
Shaohuai Shi, Xiaowen Chu

* 7 pages 
  Access Paper or Ask Questions
Benchmarking State-of-the-Art Deep Learning Software Tools

Feb 17, 2017
Shaohuai Shi, Qiang Wang, Pengfei Xu, Xiaowen Chu

* Revision history: 1. Revise ResNet-50 configuration in MXNet. 2. Add faster implementation of ResNet-56 in TensorFlow with multiple GPUs 
  Access Paper or Ask Questions