Alert button
Picture for T. S. Eugene Ng

T. S. Eugene Ng

Alert button

Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training

Sep 23, 2023
Zhuang Wang, Zhaozhuo Xu, Anshumali Shrivastava, T. S. Eugene Ng

Figure 1 for Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training
Figure 2 for Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training
Figure 3 for Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training
Figure 4 for Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training
Viaarxiv icon

ByteComp: Revisiting Gradient Compression in Distributed Training

Jun 06, 2022
Zhuang Wang, Haibin Lin, Yibo Zhu, T. S. Eugene Ng

Figure 1 for ByteComp: Revisiting Gradient Compression in Distributed Training
Figure 2 for ByteComp: Revisiting Gradient Compression in Distributed Training
Figure 3 for ByteComp: Revisiting Gradient Compression in Distributed Training
Figure 4 for ByteComp: Revisiting Gradient Compression in Distributed Training
Viaarxiv icon

Espresso: Revisiting Gradient Compression from the System Perspective

May 28, 2022
Zhuang Wang, Haibin Lin, Yibo Zhu, T. S. Eugene Ng

Figure 1 for Espresso: Revisiting Gradient Compression from the System Perspective
Figure 2 for Espresso: Revisiting Gradient Compression from the System Perspective
Figure 3 for Espresso: Revisiting Gradient Compression from the System Perspective
Figure 4 for Espresso: Revisiting Gradient Compression from the System Perspective
Viaarxiv icon

MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training

Mar 28, 2021
Zhuang Wang, Xinyu Wu, T. S. Eugene Ng

Figure 1 for MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Figure 2 for MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Figure 3 for MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Figure 4 for MergeComp: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Viaarxiv icon