Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Hongyi Wang

A Field Guide to Federated Optimization


Jul 14, 2021
Jianyu Wang, Zachary Charles, Zheng Xu, Gauri Joshi, H. Brendan McMahan, Blaise Aguera y Arcas, Maruan Al-Shedivat, Galen Andrew, Salman Avestimehr, Katharine Daly, Deepesh Data, Suhas Diggavi, Hubert Eichner, Advait Gadhikar, Zachary Garrett, Antonious M. Girgis, Filip Hanzely, Andrew Hard, Chaoyang He, Samuel Horvath, Zhouyuan Huo, Alex Ingerman, Martin Jaggi, Tara Javidi, Peter Kairouz, Satyen Kale, Sai Praneeth Karimireddy, Jakub Konecny, Sanmi Koyejo, Tian Li, Luyang Liu, Mehryar Mohri, Hang Qi, Sashank J. Reddi, Peter Richtarik, Karan Singhal, Virginia Smith, Mahdi Soltanolkotabi, Weikang Song, Ananda Theertha Suresh, Sebastian U. Stich, Ameet Talwalkar, Hongyi Wang, Blake Woodworth, Shanshan Wu, Felix X. Yu, Honglin Yuan, Manzil Zaheer, Mi Zhang, Tong Zhang, Chunxiang Zheng, Chen Zhu, Wennan Zhu


  Access Paper or Ask Questions

Pufferfish: Communication-efficient Models At No Extra Cost


Mar 05, 2021
Hongyi Wang, Saurabh Agarwal, Dimitris Papailiopoulos

* Accepted by MLSys 2021 

  Access Paper or Ask Questions

On the Utility of Gradient Compression in Distributed Training Systems


Mar 03, 2021
Saurabh Agarwal, Hongyi Wang, Shivaram Venkataraman, Dimitris Papailiopoulos


  Access Paper or Ask Questions

Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification


Oct 29, 2020
Saurabh Agarwal, Hongyi Wang, Kangwook Lee, Shivaram Venkataraman, Dimitris Papailiopoulos


  Access Paper or Ask Questions

Few shot domain adaptation for in situ macromolecule structural classification in cryo-electron tomograms


Jul 30, 2020
Liangyong Yu, Ran Li, Xiangrui Zeng, Hongyi Wang, Jie Jin, Ge Yang, Rui Jiang, Min Xu

* Bioinformatics 2020 
* This article has been accepted for publication in Bioinformatics Published by Oxford University Press 

  Access Paper or Ask Questions

FedML: A Research Library and Benchmark for Federated Machine Learning


Jul 27, 2020
Chaoyang He, Songze Li, Jinhyun So, Mi Zhang, Hongyi Wang, Xiaoyang Wang, Praneeth Vepakomma, Abhishek Singh, Hang Qiu, Li Shen, Peilin Zhao, Yan Kang, Yang Liu, Ramesh Raskar, Qiang Yang, Murali Annavaram, Salman Avestimehr

* We maintain the source code, documents, and user community at https://fedml.ai 

  Access Paper or Ask Questions

Attack of the Tails: Yes, You Really Can Backdoor Federated Learning


Jul 09, 2020
Hongyi Wang, Kartik Sreenivasan, Shashank Rajput, Harit Vishwakarma, Saurabh Agarwal, Jy-yong Sohn, Kangwook Lee, Dimitris Papailiopoulos


  Access Paper or Ask Questions

Federated Learning with Matched Averaging


Feb 15, 2020
Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, Yasaman Khazaeni

* Accepted by ICLR 2020 

  Access Paper or Ask Questions

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation


Jul 29, 2019
Shashank Rajput, Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos


  Access Paper or Ask Questions

ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding


Jan 28, 2019
Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos


  Access Paper or Ask Questions

ATOMO: Communication-efficient Learning via Atomic Sparsification


Jun 24, 2018
Hongyi Wang, Scott Sievert, Shengchao Liu, Zachary Charles, Dimitris Papailiopoulos, Stephen Wright


  Access Paper or Ask Questions

DRACO: Byzantine-resilient Distributed Training via Redundant Gradients


Jun 22, 2018
Lingjiao Chen, Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos

* Accepted by ICML 2018 

  Access Paper or Ask Questions

The Effect of Network Width on the Performance of Large-batch Training


Jun 11, 2018
Lingjiao Chen, Hongyi Wang, Jinman Zhao, Dimitris Papailiopoulos, Paraschos Koutris


  Access Paper or Ask Questions