Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

ByteComp: Revisiting Gradient Compression in Distributed Training



Zhuang Wang , Haibin Lin , Yibo Zhu , T. S. Eugene Ng


   Access Paper or Ask Questions

Espresso: Revisiting Gradient Compression from the System Perspective



Zhuang Wang , Haibin Lin , Yibo Zhu , T. S. Eugene Ng


   Access Paper or Ask Questions

dPRO: A Generic Profiling and Optimization System for Expediting Distributed DNN Training



Hanpeng Hu , Chenyu Jiang , Yuchen Zhong , Yanghua Peng , Chuan Wu , Yibo Zhu , Haibin Lin , Chuanxiong Guo

* Accepted by MLSys 2022 

   Access Paper or Ask Questions

Compressed Communication for Distributed Training: Adaptive Methods and System



Yuchen Zhong , Cong Xie , Shuai Zheng , Haibin Lin


   Access Paper or Ask Questions

CSER: Communication-efficient SGD with Error Reset



Cong Xie , Shuai Zheng , Oluwasanmi Koyejo , Indranil Gupta , Mu Li , Haibin Lin


   Access Paper or Ask Questions

Is Network the Bottleneck of Distributed Training?



Zhen Zhang , Chaokun Chang , Haibin Lin , Yida Wang , Raman Arora , Xin Jin


   Access Paper or Ask Questions

Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes



Shuai Zheng , Haibin Lin , Sheng Zha , Mu Li

* Technical Report 

   Access Paper or Ask Questions

1
2
>>