Alert button
Picture for Omkar Salpekar

Omkar Salpekar

Alert button

PyTorch Distributed: Experiences on Accelerating Data Parallel Training

Jun 28, 2020
Shen Li, Yanli Zhao, Rohan Varma, Omkar Salpekar, Pieter Noordhuis, Teng Li, Adam Paszke, Jeff Smith, Brian Vaughan, Pritam Damania, Soumith Chintala

Figure 1 for PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Figure 2 for PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Figure 3 for PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Figure 4 for PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Viaarxiv icon