Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Atli Kosson

Adaptive Braking for Mitigating Gradient Delay

Jul 10, 2020
Abhinav Venigalla, Atli Kosson, Vitaliy Chiley, Urs Köster

* In Beyond First Order Methods in ML Systems workshop at the 37th International Conference on Machine Learning, 2020 

  Access Paper or Ask Questions

Pipelined Backpropagation at Scale: Training Large Models without Batches

Mar 25, 2020
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster

  Access Paper or Ask Questions

Online Normalization for Training Neural Networks

May 28, 2019
Vitaliy Chiley, Ilya Sharapov, Atli Kosson, Urs Koster, Ryan Reece, Sofia Samaniego de la Fuente, Vishal Subbiah, Michael James

* This version adds the appendix and corrects minor typos and omissions. 23 pages total 

  Access Paper or Ask Questions