Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Yusheng Su

Knowledge Inheritance for Pre-trained Language Models


May 28, 2021
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* preprint 

  Access Paper or Ask Questions

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models


Mar 03, 2021
Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions

CPM: A Large-scale Generative Chinese Pre-trained Language Model


Dec 01, 2020
Zhengyan Zhang, Xu Han, Hao Zhou, Pei Ke, Yuxian Gu, Deming Ye, Yujia Qin, Yusheng Su, Haozhe Ji, Jian Guan, Fanchao Qi, Xiaozhi Wang, Yanan Zheng, Guoyang Zeng, Huanqi Cao, Shengqi Chen, Daixuan Li, Zhenbo Sun, Zhiyuan Liu, Minlie Huang, Wentao Han, Jie Tang, Juanzi Li, Xiaoyan Zhu, Maosong Sun


  Access Paper or Ask Questions

Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models


Oct 01, 2020
Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions