Alert button
Picture for Zhize Li

Zhize Li

Alert button

Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression

Oct 29, 2023
Sijin Chen, Zhize Li, Yuejie Chi

Figure 1 for Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression
Figure 2 for Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression
Figure 3 for Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression
Viaarxiv icon

Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering

Oct 26, 2022
Lingxiao Huang, Zhize Li, Jialin Sun, Haoyu Zhao

Figure 1 for Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering
Figure 2 for Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering
Figure 3 for Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering
Figure 4 for Coresets for Vertical Federated Learning: Regularized Linear Regression and $K$-Means Clustering
Viaarxiv icon

Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization

Aug 22, 2022
Zhize Li, Jian Li

Figure 1 for Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization
Figure 2 for Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization
Figure 3 for Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization
Figure 4 for Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization
Viaarxiv icon

SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression

Jun 20, 2022
Zhize Li, Haoyu Zhao, Boyue Li, Yuejie Chi

Figure 1 for SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression
Figure 2 for SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression
Viaarxiv icon

3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation

Feb 02, 2022
Peter Richtárik, Igor Sokolov, Ilyas Fatkhullin, Elnur Gasanov, Zhize Li, Eduard Gorbunov

Figure 1 for 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
Figure 2 for 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
Figure 3 for 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
Figure 4 for 3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
Viaarxiv icon

BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression

Jan 31, 2022
Haoyu Zhao, Boyue Li, Zhize Li, Peter Richtárik, Yuejie Chi

Figure 1 for BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression
Figure 2 for BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression
Figure 3 for BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression
Figure 4 for BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression
Viaarxiv icon

Faster Rates for Compressed Federated Learning with Client-Variance Reduction

Dec 24, 2021
Haoyu Zhao, Konstantin Burlachenko, Zhize Li, Peter Richtárik

Figure 1 for Faster Rates for Compressed Federated Learning with Client-Variance Reduction
Figure 2 for Faster Rates for Compressed Federated Learning with Client-Variance Reduction
Viaarxiv icon

EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback

Oct 07, 2021
Ilyas Fatkhullin, Igor Sokolov, Eduard Gorbunov, Zhize Li, Peter Richtárik

Figure 1 for EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback
Figure 2 for EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback
Figure 3 for EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback
Figure 4 for EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback
Viaarxiv icon

DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization

Oct 04, 2021
Boyue Li, Zhize Li, Yuejie Chi

Figure 1 for DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization
Figure 2 for DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization
Figure 3 for DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization
Figure 4 for DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization
Viaarxiv icon

FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning

Aug 10, 2021
Haoyu Zhao, Zhize Li, Peter Richtárik

Figure 1 for FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning
Figure 2 for FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning
Figure 3 for FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning
Figure 4 for FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning
Viaarxiv icon