Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Siyuan Zhuang

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models


Feb 16, 2021
Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica


  Access Paper or Ask Questions

Hoplite: Efficient Collective Communication for Task-Based Distributed Systems


Feb 13, 2020
Siyuan Zhuang, Zhuohan Li, Danyang Zhuo, Stephanie Wang, Eric Liang, Robert Nishihara, Philipp Moritz, Ion Stoica


  Access Paper or Ask Questions