Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

HelixFold: An Efficient Implementation of AlphaFold2 using PaddlePaddle


Jul 13, 2022
Guoxia Wang , Xiaomin Fang , Zhihua Wu , Yiqun Liu , Yang Xue , Yingfei Xiang , Dianhai Yu , Fan Wang , Yanjun Ma


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

SE-MoE: A Scalable and Efficient Mixture-of-Experts Distributed Training and Inference System


May 20, 2022
Liang Shen , Zhihua Wu , WeiBao Gong , Hongxiang Hao , Yangfan Bai , HuaChao Wu , Xinxuan Wu , Haoyi Xiong , Dianhai Yu , Yanjun Ma


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters


May 19, 2022
Yang Xiang , Zhihua Wu , Weibao Gong , Siyu Ding , Xianjie Mo , Yuang Liu , Shuohuan Wang , Peng Liu , Yongshuai Hou , Long Li , Bin Wang , Shaohuai Shi , Yaqian Han , Yue Yu , Ge Li , Yu Sun , Yanjun Ma , Dianhai Yu

* 20 pages, 10 figures, technical report 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation


Dec 31, 2021
Han Zhang , Weichong Yin , Yewei Fang , Lanxin Li , Boqiang Duan , Zhihua Wu , Yu Sun , Hao Tian , Hua Wu , Haifeng Wang

* 15 pages, 7 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation


Dec 23, 2021
Shuohuan Wang , Yu Sun , Yang Xiang , Zhihua Wu , Siyu Ding , Weibao Gong , Shikun Feng , Junyuan Shang , Yanbin Zhao , Chao Pang , Jiaxiang Liu , Xuyi Chen , Yuxiang Lu , Weixin Liu , Xi Wang , Yangfan Bai , Qiuliang Chen , Li Zhao , Shiyong Li , Peng Sun , Dianhai Yu , Yanjun Ma , Hao Tian , Hua Wu , Tian Wu , Wei Zeng , Ge Li , Wen Gao , Haifeng Wang

* arXiv admin note: text overlap with arXiv:2107.02137 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

End-to-end Adaptive Distributed Training on PaddlePaddle


Dec 06, 2021
Yulong Ao , Zhihua Wu , Dianhai Yu , Weibao Gong , Zhiqing Kui , Minxu Zhang , Zilingfeng Ye , Liang Shen , Yanjun Ma , Tian Wu , Haifeng Wang , Wei Zeng , Chao Yang

* 16 pages, 10 figures, 4 tables 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments


Nov 20, 2021
Ji Liu , Zhihua Wu , Dianhai Yu , Yanjun Ma , Danlei Feng , Minxu Zhang , Xinxuan Wu , Xuefeng Yao , Dejing Dou

* 14 pages, 11 figures, 2 tables 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation


Sep 20, 2021
Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang , Wenquan Wu , Zhihua Wu , Zhen Guo , Hua Lu , Xinxian Huang , Xin Tian , Xinchao Xu , Yingzhan Lin , Zhengyu Niu

* First four authors contributed equally to this work 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation


Jul 05, 2021
Yu Sun , Shuohuan Wang , Shikun Feng , Siyu Ding , Chao Pang , Junyuan Shang , Jiaxiang Liu , Xuyi Chen , Yanbin Zhao , Yuxiang Lu , Weixin Liu , Zhihua Wu , Weibao Gong , Jianzhong Liang , Zhizhou Shang , Peng Sun , Wei Liu , Xuan Ouyang , Dianhai Yu , Hao Tian , Hua Wu , Haifeng Wang


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency


Jun 04, 2021
Deng Huang , Wenhao Wu , Weiwen Hu , Xu Liu , Dongliang He , Zhihua Wu , Xiangmiao Wu , Mingkui Tan , Errui Ding

* Technical report 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
>>