Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism


Jul 25, 2020
Yosuke Oyama, Naoya Maruyama, Nikoli Dryden, Erin McCarthy, Peter Harrington, Jan Balewski, Satoshi Matsuoka, Peter Nugent, Brian Van Essen

Add code

* 12 pages, 10 figures 

   Access Paper or Ask Questions

μ-cuDNN: Accelerating Deep Learning Frameworks with Micro-Batching


Apr 13, 2018
Yosuke Oyama, Tal Ben-Nun, Torsten Hoefler, Satoshi Matsuoka

Add code

* 11 pages, 14 figures. Part of the content have been published in IPSJ SIG Technical Report, Vol. 2017-HPC-162, No. 22, pp. 1-9, 2017. (DOI: http://id.nii.ac.jp/1001/00184814

   Access Paper or Ask Questions