Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Dimitris Papailiopoulos

Finding Everything within Random Binary Networks

Oct 18, 2021
Kartik Sreenivasan, Shashank Rajput, Jy-yong Sohn, Dimitris Papailiopoulos

  Access Paper or Ask Questions

An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks

Jun 14, 2021
Shashank Rajput, Kartik Sreenivasan, Dimitris Papailiopoulos, Amin Karbasi

  Access Paper or Ask Questions

Pufferfish: Communication-efficient Models At No Extra Cost

Mar 05, 2021
Hongyi Wang, Saurabh Agarwal, Dimitris Papailiopoulos

* Accepted by MLSys 2021 

  Access Paper or Ask Questions

On the Utility of Gradient Compression in Distributed Training Systems

Mar 03, 2021
Saurabh Agarwal, Hongyi Wang, Shivaram Venkataraman, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Permutation-Based SGD: Is Random Optimal?

Feb 19, 2021
Shashank Rajput, Kangwook Lee, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification

Oct 29, 2020
Saurabh Agarwal, Hongyi Wang, Kangwook Lee, Shivaram Venkataraman, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Attack of the Tails: Yes, You Really Can Backdoor Federated Learning

Jul 09, 2020
Hongyi Wang, Kartik Sreenivasan, Shashank Rajput, Harit Vishwakarma, Saurabh Agarwal, Jy-yong Sohn, Kangwook Lee, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient

Jun 14, 2020
Ankit Pensia, Shashank Rajput, Alliot Nagle, Harit Vishwakarma, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Closing the convergence gap of SGD without replacement

Mar 05, 2020
Shashank Rajput, Anant Gupta, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Federated Learning with Matched Averaging

Feb 15, 2020
Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, Yasaman Khazaeni

* Accepted by ICLR 2020 

  Access Paper or Ask Questions

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

Jul 29, 2019
Shashank Rajput, Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Bad Global Minima Exist and SGD Can Reach Them

Jun 06, 2019
Shengchao Liu, Dimitris Papailiopoulos, Dimitris Achlioptas

  Access Paper or Ask Questions

Convergence and Margin of Adversarial Training on Separable Data

May 22, 2019
Zachary Charles, Shashank Rajput, Stephen Wright, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Does Data Augmentation Lead to Positive Margin?

May 08, 2019
Shashank Rajput, Zhili Feng, Zachary Charles, Po-Ling Loh, Dimitris Papailiopoulos

* ICML 2019 

  Access Paper or Ask Questions

SysML: The New Frontier of Machine Learning Systems

May 01, 2019
Alexander Ratner, Dan Alistarh, Gustavo Alonso, David G. Andersen, Peter Bailis, Sarah Bird, Nicholas Carlini, Bryan Catanzaro, Jennifer Chayes, Eric Chung, Bill Dally, Jeff Dean, Inderjit S. Dhillon, Alexandros Dimakis, Pradeep Dubey, Charles Elkan, Grigori Fursin, Gregory R. Ganger, Lise Getoor, Phillip B. Gibbons, Garth A. Gibson, Joseph E. Gonzalez, Justin Gottschlich, Song Han, Kim Hazelwood, Furong Huang, Martin Jaggi, Kevin Jamieson, Michael I. Jordan, Gauri Joshi, Rania Khalaf, Jason Knight, Jakub Konečný, Tim Kraska, Arun Kumar, Anastasios Kyrillidis, Aparna Lakshmiratan, Jing Li, Samuel Madden, H. Brendan McMahan, Erik Meijer, Ioannis Mitliagkas, Rajat Monga, Derek Murray, Kunle Olukotun, Dimitris Papailiopoulos, Gennady Pekhimenko, Theodoros Rekatsinas, Afshin Rostamizadeh, Christopher Ré, Christopher De Sa, Hanie Sedghi, Siddhartha Sen, Virginia Smith, Alex Smola, Dawn Song, Evan Sparks, Ion Stoica, Vivienne Sze, Madeleine Udell, Joaquin Vanschoren, Shivaram Venkataraman, Rashmi Vinayak, Markus Weimer, Andrew Gordon Wilson, Eric Xing, Matei Zaharia, Ce Zhang, Ameet Talwalkar

  Access Paper or Ask Questions

ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding

Jan 28, 2019
Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos

  Access Paper or Ask Questions

A Geometric Perspective on the Transferability of Adversarial Directions

Nov 08, 2018
Zachary Charles, Harrison Rosenberg, Dimitris Papailiopoulos

  Access Paper or Ask Questions

ATOMO: Communication-efficient Learning via Atomic Sparsification

Jun 24, 2018
Hongyi Wang, Scott Sievert, Shengchao Liu, Zachary Charles, Dimitris Papailiopoulos, Stephen Wright

  Access Paper or Ask Questions

DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

Jun 22, 2018
Lingjiao Chen, Hongyi Wang, Zachary Charles, Dimitris Papailiopoulos

* Accepted by ICML 2018 

  Access Paper or Ask Questions

The Effect of Network Width on the Performance of Large-batch Training

Jun 11, 2018
Lingjiao Chen, Hongyi Wang, Jinman Zhao, Dimitris Papailiopoulos, Paraschos Koutris

  Access Paper or Ask Questions

Gradient Coding via the Stochastic Block Model

May 25, 2018
Zachary Charles, Dimitris Papailiopoulos

  Access Paper or Ask Questions

Speeding Up Distributed Machine Learning Using Codes

Jan 29, 2018
Kangwook Lee, Maximilian Lam, Ramtin Pedarsani, Dimitris Papailiopoulos, Kannan Ramchandran

* This work is published in IEEE Transactions on Information Theory and presented in part at the NIPS 2015 Workshop on Machine Learning Systems and the IEEE ISIT 2016 

  Access Paper or Ask Questions

Gradient Diversity: a Key Ingredient for Scalable Distributed Learning

Jan 07, 2018
Dong Yin, Ashwin Pananjady, Max Lam, Dimitris Papailiopoulos, Kannan Ramchandran, Peter Bartlett

  Access Paper or Ask Questions

Approximate Gradient Coding via Sparse Random Graphs

Nov 17, 2017
Zachary Charles, Dimitris Papailiopoulos, Jordan Ellenberg

  Access Paper or Ask Questions

Stability and Generalization of Learning Algorithms that Converge to Global Optima

Oct 23, 2017
Zachary Charles, Dimitris Papailiopoulos

* 27 pages, 5 figures 

  Access Paper or Ask Questions

CYCLADES: Conflict-free Asynchronous Machine Learning

May 31, 2016
Xinghao Pan, Maximilian Lam, Stephen Tu, Dimitris Papailiopoulos, Ce Zhang, Michael I. Jordan, Kannan Ramchandran, Chris Re, Benjamin Recht

  Access Paper or Ask Questions

Perturbed Iterate Analysis for Asynchronous Stochastic Optimization

Mar 25, 2016
Horia Mania, Xinghao Pan, Dimitris Papailiopoulos, Benjamin Recht, Kannan Ramchandran, Michael I. Jordan

* 30 pages 

  Access Paper or Ask Questions