Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Zhize Li

EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback


Oct 07, 2021
Ilyas Fatkhullin, Igor Sokolov, Eduard Gorbunov, Zhize Li, Peter Richtárik

* 71 pages, 7 algorithms, 18 Lemmas, 13 Theorems, 18 Corollaries, 6 Tables, 7 Figures 

  Access Paper or Ask Questions

DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization


Oct 04, 2021
Boyue Li, Zhize Li, Yuejie Chi


  Access Paper or Ask Questions

FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning


Aug 10, 2021
Haoyu Zhao, Zhize Li, Peter Richtárik

* 42 pages 

  Access Paper or Ask Questions

CANITA: Faster Rates for Distributed Convex Optimization with Communication Compression


Jul 20, 2021
Zhize Li, Peter Richtárik

* 21 pages 

  Access Paper or Ask Questions

A Short Note of PAGE: Optimal Convergence Rates for Nonconvex Optimization


Jun 17, 2021
Zhize Li

* 4 pages 

  Access Paper or Ask Questions

ANITA: An Optimal Loopless Accelerated Variance-Reduced Gradient Method


Mar 21, 2021
Zhize Li

* 20 pages 

  Access Paper or Ask Questions

ZeroSARAH: Efficient Nonconvex Finite-Sum Optimization with Zero Full Gradient Computation


Mar 02, 2021
Zhize Li, Peter Richtárik


  Access Paper or Ask Questions

MARINA: Faster Non-Convex Distributed Learning with Compression


Feb 15, 2021
Eduard Gorbunov, Konstantin Burlachenko, Zhize Li, Peter Richtárik

* 48 pages, 3 figures, 3 algorithms 

  Access Paper or Ask Questions

PAGE: A Simple and Optimal Probabilistic Gradient Estimator for Nonconvex Optimization


Aug 25, 2020
Zhize Li, Hongyan Bao, Xiangliang Zhang, Peter Richtárik

* 30 pages 

  Access Paper or Ask Questions

A Unified Analysis of Stochastic Gradient Methods for Nonconvex Federated Optimization


Jun 12, 2020
Zhize Li, Peter Richtárik

* 77 pages 

  Access Paper or Ask Questions

Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization


Feb 26, 2020
Zhize Li, Dmitry Kovalev, Xun Qian, Peter Richtárik

* 27 pages, 2 algoritms, 4 theorems, 5 lemmas, 10 figures 

  Access Paper or Ask Questions

A unified variance-reduced accelerated gradient method for convex optimization


May 30, 2019
Guanghui Lan, Zhize Li, Yi Zhou

* 25 pages 

  Access Paper or Ask Questions

Stabilized SVRG: Simple Variance Reduction for Nonconvex Optimization


May 01, 2019
Rong Ge, Zhize Li, Weiyao Wang, Xiang Wang


  Access Paper or Ask Questions

SSRGD: Simple Stochastic Recursive Gradient Descent for Escaping Saddle Points


Apr 19, 2019
Zhize Li

* 44 pages 

  Access Paper or Ask Questions

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization


Oct 27, 2018
Zhize Li, Jian Li

* 32nd Conference on Neural Information Processing Systems (NIPS 2018) 

  Access Paper or Ask Questions

Learning Two-layer Neural Networks with Symmetric Inputs


Oct 16, 2018
Rong Ge, Rohith Kuditipudi, Zhize Li, Xiang Wang


  Access Paper or Ask Questions

An Anderson-Chebyshev Mixing Method for Nonlinear Optimization


Sep 07, 2018
Zhize Li, Jian Li

* 20 pages 

  Access Paper or Ask Questions

Gradient Boosting With Piece-Wise Linear Regression Trees


Apr 04, 2018
Yu Shi, Jian Li, Zhize Li


  Access Paper or Ask Questions

Stochastic Gradient Hamiltonian Monte Carlo with Variance Reduction for Bayesian Inference


Mar 29, 2018
Zhize Li, Tianyi Zhang, Jian Li

* 20 pages 

  Access Paper or Ask Questions