Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

A Roadmap for Big Model


Apr 02, 2022
Sha Yuan , Hanyu Zhao , Shuai Zhao , Jiahong Leng , Yangxiao Liang , Xiaozhi Wang , Jifan Yu , Xin Lv , Zhou Shao , Jiaao He , Yankai Lin , Xu Han , Zhenghao Liu , Ning Ding , Yongming Rao , Yizhao Gao , Liang Zhang , Ming Ding , Cong Fang , Yisen Wang , Mingsheng Long , Jing Zhang , Yinpeng Dong , Tianyu Pang , Peng Cui , Lingxiao Huang , Zheng Liang , Huawei Shen , Hui Zhang , Quanshi Zhang , Qingxiu Dong , Zhixing Tan , Mingxuan Wang , Shuo Wang , Long Zhou , Haoran Li , Junwei Bao , Yingwei Pan , Weinan Zhang , Zhou Yu , Rui Yan , Chence Shi , Minghao Xu , Zuobai Zhang , Guoqiang Wang , Xiang Pan , Mengjie Li , Xiaoyu Chu , Zijun Yao , Fangwei Zhu , Shulin Cao , Weicheng Xue , Zixuan Ma , Zhengyan Zhang , Shengding Hu , Yujia Qin , Chaojun Xiao , Zheni Zeng , Ganqu Cui , Weize Chen , Weilin Zhao , Yuan Yao , Peng Li , Wenzhao Zheng , Wenliang Zhao , Ziyi Wang , Borui Zhang , Nanyi Fei , Anwen Hu , Zenan Ling , Haoyang Li , Boxi Cao , Xianpei Han , Weidong Zhan , Baobao Chang , Hao Sun , Jiawen Deng , Chujie Zheng , Juanzi Li , Lei Hou , Xigang Cao , Jidong Zhai , Zhiyuan Liu , Maosong Sun , Jiwen Lu , Zhiwu Lu , Qin Jin , Ruihua Song , Ji-Rong Wen , Zhouchen Lin , Liwei Wang , Hang Su , Jun Zhu , Zhifang Sui , Jiajun Zhang , Yang Liu , Xiaodong He , Minlie Huang , Jian Tang , Jie Tang

* arXiv admin note: text overlap with arXiv:2107.06499 by other authors 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

FastMoE: A Fast Mixture-of-Expert Training System


Mar 24, 2021
Jiaao He , Jiezhong Qiu , Aohan Zeng , Zhilin Yang , Jidong Zhai , Jie Tang


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Heterogeneity-Aware Asynchronous Decentralized Training


Sep 17, 2019
Qinyi Luo , Jiaao He , Youwei Zhuo , Xuehai Qian


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email