Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Zhengda Bian

Zhengda Bian

Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters

Aug 08, 2021
Zhengda Bian, Shenggui Li, Wei Wang, Yang You

Figure 1 for Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters

Figure 2 for Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters

Figure 3 for Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters

Figure 4 for Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters

* This paper has been accepted by the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC21), Nov 14-19, 2021, St. Louis, USA

Access Paper or Ask Questions

Maximizing Parallelism in Distributed Training for Huge Neural Networks

May 30, 2021
Zhengda Bian, Qifan Xu, Boxiang Wang, Yang You

Figure 1 for Maximizing Parallelism in Distributed Training for Huge Neural Networks

Figure 2 for Maximizing Parallelism in Distributed Training for Huge Neural Networks

Figure 3 for Maximizing Parallelism in Distributed Training for Huge Neural Networks

Figure 4 for Maximizing Parallelism in Distributed Training for Huge Neural Networks

* Technical Report of NUS HPC-AI Lab (https://ai.comp.nus.edu.sg). The leading two authors have equal contributions

Access Paper or Ask Questions