Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Zhengyan Zhang

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models


Mar 03, 2021
Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks


Jan 19, 2021
Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun


  Access Paper or Ask Questions

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning


Dec 31, 2020
Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun

* 9 pages 

  Access Paper or Ask Questions

CPM: A Large-scale Generative Chinese Pre-trained Language Model


Dec 01, 2020
Zhengyan Zhang, Xu Han, Hao Zhou, Pei Ke, Yuxian Gu, Deming Ye, Yujia Qin, Yusheng Su, Haozhe Ji, Jian Guan, Fanchao Qi, Xiaozhi Wang, Yanan Zheng, Guoyang Zeng, Huanqi Cao, Shengqi Chen, Daixuan Li, Zhenbo Sun, Zhiyuan Liu, Minlie Huang, Wentao Han, Jie Tang, Juanzi Li, Xiaoyan Zhu, Maosong Sun


  Access Paper or Ask Questions

Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads


Nov 07, 2020
Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Qun Liu, Maosong Sun


  Access Paper or Ask Questions

Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models


Oct 01, 2020
Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions

Train No Evil: Selective Masking for Task-guided Pre-training


Apr 21, 2020
Yuxian Gu, Zhengyan Zhang, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun

* 6 pages, 2 figures 

  Access Paper or Ask Questions

Adversarial Language Games for Advanced Natural Language Intelligence


Nov 08, 2019
Yuan Yao, Haoxi Zhong, Zhengyan Zhang, Xu Han, Xiaozhi Wang, Chaojun Xiao, Guoyang Zeng, Zhiyuan Liu, Maosong Sun

* Work in progress 

  Access Paper or Ask Questions

ERNIE: Enhanced Language Representation with Informative Entities


Jun 04, 2019
Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, Qun Liu

* Accepted by ACL 2019 

  Access Paper or Ask Questions

Graph Neural Networks: A Review of Methods and Applications


Jan 02, 2019
Jie Zhou, Ganqu Cui, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Maosong Sun


  Access Paper or Ask Questions

COSINE: Compressive Network Embedding on Large-scale Information Networks


Dec 21, 2018
Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Maosong Sun, Zhichong Fang, Bo Zhang, Leyu Lin


  Access Paper or Ask Questions