Alert button
Picture for Zhouyuan Huo

Zhouyuan Huo

Alert button

Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning

Aug 14, 2020
Bin Gu, An Xu, Zhouyuan Huo, Cheng Deng, Heng Huang

Figure 1 for Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning
Figure 2 for Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning
Figure 3 for Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning
Figure 4 for Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning
Viaarxiv icon

Training Faster with Compressed Gradient

Aug 13, 2020
An Xu, Zhouyuan Huo, Heng Huang

Figure 1 for Training Faster with Compressed Gradient
Figure 2 for Training Faster with Compressed Gradient
Figure 3 for Training Faster with Compressed Gradient
Viaarxiv icon

Exploit Where Optimizer Explores via Residuals

Apr 11, 2020
An Xu, Zhouyuan Huo, Heng Huang

Figure 1 for Exploit Where Optimizer Explores via Residuals
Figure 2 for Exploit Where Optimizer Explores via Residuals
Figure 3 for Exploit Where Optimizer Explores via Residuals
Figure 4 for Exploit Where Optimizer Explores via Residuals
Viaarxiv icon

Optimal Gradient Quantization Condition for Communication-Efficient Distributed Training

Feb 25, 2020
An Xu, Zhouyuan Huo, Heng Huang

Figure 1 for Optimal Gradient Quantization Condition for Communication-Efficient Distributed Training
Figure 2 for Optimal Gradient Quantization Condition for Communication-Efficient Distributed Training
Figure 3 for Optimal Gradient Quantization Condition for Communication-Efficient Distributed Training
Figure 4 for Optimal Gradient Quantization Condition for Communication-Efficient Distributed Training
Viaarxiv icon

Faster On-Device Training Using New Federated Momentum Algorithm

Feb 06, 2020
Zhouyuan Huo, Qian Yang, Bin Gu, Lawrence Carin. Heng Huang

Figure 1 for Faster On-Device Training Using New Federated Momentum Algorithm
Figure 2 for Faster On-Device Training Using New Federated Momentum Algorithm
Figure 3 for Faster On-Device Training Using New Federated Momentum Algorithm
Figure 4 for Faster On-Device Training Using New Federated Momentum Algorithm
Viaarxiv icon

Large Batch Training Does Not Need Warmup

Feb 04, 2020
Zhouyuan Huo, Bin Gu, Heng Huang

Figure 1 for Large Batch Training Does Not Need Warmup
Figure 2 for Large Batch Training Does Not Need Warmup
Figure 3 for Large Batch Training Does Not Need Warmup
Figure 4 for Large Batch Training Does Not Need Warmup
Viaarxiv icon

Advances and Open Problems in Federated Learning

Dec 10, 2019
Peter Kairouz, H. Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, Rafael G. L. D'Oliveira, Salim El Rouayheb, David Evans, Josh Gardner, Zachary Garrett, Adrià Gascón, Badih Ghazi, Phillip B. Gibbons, Marco Gruteser, Zaid Harchaoui, Chaoyang He, Lie He, Zhouyuan Huo, Ben Hutchinson, Justin Hsu, Martin Jaggi, Tara Javidi, Gauri Joshi, Mikhail Khodak, Jakub Konečný, Aleksandra Korolova, Farinaz Koushanfar, Sanmi Koyejo, Tancrède Lepoint, Yang Liu, Prateek Mittal, Mehryar Mohri, Richard Nock, Ayfer Özgür, Rasmus Pagh, Mariana Raykova, Hang Qi, Daniel Ramage, Ramesh Raskar, Dawn Song, Weikang Song, Sebastian U. Stich, Ziteng Sun, Ananda Theertha Suresh, Florian Tramèr, Praneeth Vepakomma, Jianyu Wang, Li Xiong, Zheng Xu, Qiang Yang, Felix X. Yu, Han Yu, Sen Zhao

Figure 1 for Advances and Open Problems in Federated Learning
Figure 2 for Advances and Open Problems in Federated Learning
Figure 3 for Advances and Open Problems in Federated Learning
Figure 4 for Advances and Open Problems in Federated Learning
Viaarxiv icon

Straggler-Agnostic and Communication-Efficient Distributed Primal-Dual Algorithm for High-Dimensional Data Mining

Oct 09, 2019
Zhouyuan Huo, Heng Huang

Figure 1 for Straggler-Agnostic and Communication-Efficient Distributed Primal-Dual Algorithm for High-Dimensional Data Mining
Figure 2 for Straggler-Agnostic and Communication-Efficient Distributed Primal-Dual Algorithm for High-Dimensional Data Mining
Figure 3 for Straggler-Agnostic and Communication-Efficient Distributed Primal-Dual Algorithm for High-Dimensional Data Mining
Figure 4 for Straggler-Agnostic and Communication-Efficient Distributed Primal-Dual Algorithm for High-Dimensional Data Mining
Viaarxiv icon

Diversely Stale Parameters for Efficient Training of CNNs

Sep 24, 2019
An Xu, Zhouyuan Huo, Heng Huang

Figure 1 for Diversely Stale Parameters for Efficient Training of CNNs
Figure 2 for Diversely Stale Parameters for Efficient Training of CNNs
Figure 3 for Diversely Stale Parameters for Efficient Training of CNNs
Figure 4 for Diversely Stale Parameters for Efficient Training of CNNs
Viaarxiv icon

Ouroboros: On Accelerating Training of Transformer-Based Language Models

Sep 14, 2019
Qian Yang, Zhouyuan Huo, Wenlin Wang, Heng Huang, Lawrence Carin

Figure 1 for Ouroboros: On Accelerating Training of Transformer-Based Language Models
Figure 2 for Ouroboros: On Accelerating Training of Transformer-Based Language Models
Figure 3 for Ouroboros: On Accelerating Training of Transformer-Based Language Models
Figure 4 for Ouroboros: On Accelerating Training of Transformer-Based Language Models
Viaarxiv icon