Picture for Konstantin Burlachenko

Konstantin Burlachenko

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

Add code
May 23, 2024
Viaarxiv icon

Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants

Feb 16, 2024
Figure 1 for Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants
Figure 2 for Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants
Figure 3 for Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants
Figure 4 for Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants
Viaarxiv icon

Federated Learning is Better with Non-Homomorphic Encryption

Add code
Dec 04, 2023
Figure 1 for Federated Learning is Better with Non-Homomorphic Encryption
Figure 2 for Federated Learning is Better with Non-Homomorphic Encryption
Figure 3 for Federated Learning is Better with Non-Homomorphic Encryption
Figure 4 for Federated Learning is Better with Non-Homomorphic Encryption
Viaarxiv icon

Error Feedback Shines when Features are Rare

Add code
May 24, 2023
Figure 1 for Error Feedback Shines when Features are Rare
Figure 2 for Error Feedback Shines when Features are Rare
Figure 3 for Error Feedback Shines when Features are Rare
Figure 4 for Error Feedback Shines when Features are Rare
Viaarxiv icon

Federated Learning with Regularized Client Participation

Feb 28, 2023
Figure 1 for Federated Learning with Regularized Client Participation
Figure 2 for Federated Learning with Regularized Client Participation
Figure 3 for Federated Learning with Regularized Client Participation
Figure 4 for Federated Learning with Regularized Client Participation
Viaarxiv icon

Personalized Federated Learning with Communication Compression

Add code
Sep 12, 2022
Figure 1 for Personalized Federated Learning with Communication Compression
Figure 2 for Personalized Federated Learning with Communication Compression
Figure 3 for Personalized Federated Learning with Communication Compression
Figure 4 for Personalized Federated Learning with Communication Compression
Viaarxiv icon

Federated Optimization Algorithms with Random Reshuffling and Gradient Compression

Add code
Jun 14, 2022
Figure 1 for Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
Figure 2 for Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
Figure 3 for Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
Figure 4 for Federated Optimization Algorithms with Random Reshuffling and Gradient Compression
Viaarxiv icon

Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling

Add code
Jun 05, 2022
Figure 1 for Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling
Figure 2 for Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling
Figure 3 for Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling
Figure 4 for Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling
Viaarxiv icon

FL_PyTorch: optimization research simulator for federated learning

Add code
Feb 07, 2022
Figure 1 for FL_PyTorch: optimization research simulator for federated learning
Figure 2 for FL_PyTorch: optimization research simulator for federated learning
Figure 3 for FL_PyTorch: optimization research simulator for federated learning
Figure 4 for FL_PyTorch: optimization research simulator for federated learning
Viaarxiv icon

Faster Rates for Compressed Federated Learning with Client-Variance Reduction

Dec 24, 2021
Figure 1 for Faster Rates for Compressed Federated Learning with Client-Variance Reduction
Figure 2 for Faster Rates for Compressed Federated Learning with Client-Variance Reduction
Viaarxiv icon