Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Haibin Lin

CSER: Communication-efficient SGD with Error Reset


Jul 29, 2020
Cong Xie, Shuai Zheng, Oluwasanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin


  Access Paper or Ask Questions

Is Network the Bottleneck of Distributed Training?


Jun 24, 2020
Zhen Zhang, Chaokun Chang, Haibin Lin, Yida Wang, Raman Arora, Xin Jin


  Access Paper or Ask Questions

Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes


Jun 24, 2020
Shuai Zheng, Haibin Lin, Sheng Zha, Mu Li

* Technical Report 

  Access Paper or Ask Questions

ResNeSt: Split-Attention Networks


Apr 19, 2020
Hang Zhang, Chongruo Wu, Zhongyue Zhang, Yi Zhu, Zhi Zhang, Haibin Lin, Yue Sun, Tong He, Jonas Mueller, R. Manmatha, Mu Li, Alexander Smola


  Access Paper or Ask Questions

Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates


Nov 20, 2019
Cong Xie, Oluwasanmi Koyejo, Indranil Gupta, Haibin Lin


  Access Paper or Ask Questions

Deep Graph Library: Towards Efficient and Scalable Deep Learning on Graphs


Sep 03, 2019
Minjie Wang, Lingfan Yu, Da Zheng, Quan Gan, Yu Gai, Zihao Ye, Mufei Li, Jinjing Zhou, Qi Huang, Chao Ma, Ziyue Huang, Qipeng Guo, Hao Zhang, Haibin Lin, Junbo Zhao, Jinyang Li, Alexander Smola, Zheng Zhang


  Access Paper or Ask Questions

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing


Jul 09, 2019
Jian Guo, He He, Tong He, Leonard Lausen, Mu Li, Haibin Lin, Xingjian Shi, Chenguang Wang, Junyuan Xie, Sheng Zha, Aston Zhang, Hang Zhang, Zhi Zhang, Zhongyue Zhang, Shuai Zheng


  Access Paper or Ask Questions

Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources


May 02, 2019
Haibin Lin, Hang Zhang, Yifei Ma, Tong He, Zhi Zhang, Sheng Zha, Mu Li


  Access Paper or Ask Questions