Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Pieter Noordhuis

PyTorch Distributed: Experiences on Accelerating Data Parallel Training


Jun 28, 2020
Shen Li, Yanli Zhao, Rohan Varma, Omkar Salpekar, Pieter Noordhuis, Teng Li, Adam Paszke, Jeff Smith, Brian Vaughan, Pritam Damania, Soumith Chintala

* To appear in VLDB 2020 

  Access Paper or Ask Questions

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour


Apr 30, 2018
Priya Goyal, Piotr Dollár, Ross Girshick, Pieter Noordhuis, Lukasz Wesolowski, Aapo Kyrola, Andrew Tulloch, Yangqing Jia, Kaiming He

* Tech report (v2: correct typos) 

  Access Paper or Ask Questions