Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

PyTorch Distributed: Experiences on Accelerating Data Parallel Training


Jun 28, 2020
Shen Li, Yanli Zhao, Rohan Varma, Omkar Salpekar, Pieter Noordhuis, Teng Li, Adam Paszke, Jeff Smith, Brian Vaughan, Pritam Damania, Soumith Chintala

Add code

* To appear in VLDB 2020 

   Access Paper or Ask Questions

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour


Apr 30, 2018
Priya Goyal, Piotr Dollár, Ross Girshick, Pieter Noordhuis, Lukasz Wesolowski, Aapo Kyrola, Andrew Tulloch, Yangqing Jia, Kaiming He

Add code

* Tech report (v2: correct typos) 

   Access Paper or Ask Questions