Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Asymptotic Network Independence in Distributed Optimization for Machine Learning

Jun 28, 2019
Alex Olshevsky, Ioannis Ch. Paschalidis, Shi Pu

We provide a discussion of several recent results which have overcome a key barrier in distributed optimization for machine learning. Our focus is the so-called network independence property, which is achieved whenever a distributed method executed over a network of $n$ nodes achieves comparable performance to a centralized method with the same computational power as the entire network. We explain this property through an example involving of training ML models and sketch a short mathematical analysis.

Share this with someone who'll enjoy it:

   Access Paper Source

Share this with someone who'll enjoy it: