Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Xiangru Lian

BAGUA: Scaling up Distributed Learning with System Relaxations


Jul 12, 2021
Shaoduo Gan, Xiangru Lian, Rui Wang, Jianbin Chang, Chengjun Liu, Hongmei Shi, Shengzhuo Zhang, Xianghong Li, Tengxu Sun, Jiawei Jiang, Binhang Yuan, Sen Yang, Ji Liu, Ce Zhang


  Access Paper or Ask Questions

DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning


Jun 11, 2021
Daochen Zha, Jingru Xie, Wenye Ma, Sheng Zhang, Xiangru Lian, Xia Hu, Ji Liu

* Accepted by ICML 2021 

  Access Paper or Ask Questions

1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed


Feb 04, 2021
Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He

* arXiv admin note: text overlap with arXiv:2008.11343 

  Access Paper or Ask Questions

APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm


Aug 28, 2020
Hanlin Tang, Shaoduo Gan, Samyam Rajbhandari, Xiangru Lian, Ji Liu, Yuxiong He, Ce Zhang


  Access Paper or Ask Questions

Stochastic Recursive Momentum for Policy Gradient Methods


Mar 09, 2020
Huizhuo Yuan, Xiangru Lian, Ji Liu, Yuren Zhou


  Access Paper or Ask Questions

Stochastic Recursive Variance Reduction for Efficient Smooth Non-Convex Compositional Optimization


Jan 25, 2020
Huizhuo Yuan, Xiangru Lian, Ji Liu


  Access Paper or Ask Questions

$\texttt{DeepSqueeze}$: Decentralization Meets Error-Compensated Compression


Aug 03, 2019
Hanlin Tang, Xiangru Lian, Shuang Qiu, Lei Yuan, Ce Zhang, Tong Zhang, Ji Liu


  Access Paper or Ask Questions

$\texttt{DeepSqueeze}$: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression


Jul 17, 2019
Hanlin Tang, Xiangru Lian, Shuang Qiu, Lei Yuan, Ce Zhang, Tong Zhang, Ji Liu


  Access Paper or Ask Questions

DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression


May 15, 2019
Hanlin Tang, Xiangru Lian, Tong Zhang, Ji Liu


  Access Paper or Ask Questions

Revisit Batch Normalization: New Understanding from an Optimization View and a Refinement via Composition Optimization


Oct 15, 2018
Xiangru Lian, Ji Liu


  Access Paper or Ask Questions

Asynchronous Decentralized Parallel Stochastic Gradient Descent


Sep 25, 2018
Xiangru Lian, Wei Zhang, Ce Zhang, Ji Liu


  Access Paper or Ask Questions

D$^2$: Decentralized Training over Decentralized Data


Apr 20, 2018
Hanlin Tang, Xiangru Lian, Ming Yan, Ce Zhang, Ji Liu


  Access Paper or Ask Questions

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent


Sep 11, 2017
Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, Ji Liu


  Access Paper or Ask Questions

Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization


Jun 10, 2017
Xiangru Lian, Yijun Huang, Yuncheng Li, Ji Liu

* 31 pages 

  Access Paper or Ask Questions

Staleness-aware Async-SGD for Distributed Deep Learning


Apr 05, 2016
Wei Zhang, Suyog Gupta, Xiangru Lian, Ji Liu

* Accepted by IJCAI 2016 

  Access Paper or Ask Questions