Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

ProQA: Structural Prompt-based Pre-training for Unified Question Answering



Wanjun Zhong , Yifan Gao , Ning Ding , Yujia Qin , Zhiyuan Liu , Ming Zhou , Jiahai Wang , Jian Yin , Nan Duan

* NAACL 2022 

   Access Paper or Ask Questions

A Roadmap for Big Model



Sha Yuan , Hanyu Zhao , Shuai Zhao , Jiahong Leng , Yangxiao Liang , Xiaozhi Wang , Jifan Yu , Xin Lv , Zhou Shao , Jiaao He , Yankai Lin , Xu Han , Zhenghao Liu , Ning Ding , Yongming Rao , Yizhao Gao , Liang Zhang , Ming Ding , Cong Fang , Yisen Wang , Mingsheng Long , Jing Zhang , Yinpeng Dong , Tianyu Pang , Peng Cui , Lingxiao Huang , Zheng Liang , Huawei Shen , Hui Zhang , Quanshi Zhang , Qingxiu Dong , Zhixing Tan , Mingxuan Wang , Shuo Wang , Long Zhou , Haoran Li , Junwei Bao , Yingwei Pan , Weinan Zhang , Zhou Yu , Rui Yan , Chence Shi , Minghao Xu , Zuobai Zhang , Guoqiang Wang , Xiang Pan , Mengjie Li , Xiaoyu Chu , Zijun Yao , Fangwei Zhu , Shulin Cao , Weicheng Xue , Zixuan Ma , Zhengyan Zhang , Shengding Hu , Yujia Qin , Chaojun Xiao , Zheni Zeng , Ganqu Cui , Weize Chen , Weilin Zhao , Yuan Yao , Peng Li , Wenzhao Zheng , Wenliang Zhao , Ziyi Wang , Borui Zhang , Nanyi Fei , Anwen Hu , Zenan Ling , Haoyang Li , Boxi Cao , Xianpei Han , Weidong Zhan , Baobao Chang , Hao Sun , Jiawen Deng , Chujie Zheng , Juanzi Li , Lei Hou , Xigang Cao , Jidong Zhai , Zhiyuan Liu , Maosong Sun , Jiwen Lu , Zhiwu Lu , Qin Jin , Ruihua Song , Ji-Rong Wen , Zhouchen Lin , Liwei Wang , Hang Su , Jun Zhu , Zhifang Sui , Jiajun Zhang , Yang Liu , Xiaodong He , Minlie Huang , Jian Tang , Jie Tang

* arXiv admin note: text overlap with arXiv:2107.06499 by other authors 

   Access Paper or Ask Questions

Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models



Ning Ding , Yujia Qin , Guang Yang , Fuchao Wei , Zonghan Yang , Yusheng Su , Shengding Hu , Yulin Chen , Chi-Min Chan , Weize Chen , Jing Yi , Weilin Zhao , Xiaozhi Wang , Zhiyuan Liu , Hai-Tao Zheng , Jianfei Chen , Yang Liu , Jie Tang , Juanzi Li , Maosong Sun

* 49 pages 

   Access Paper or Ask Questions

ELLE: Efficient Lifelong Pre-training for Emerging Data



Yujia Qin , Jiajie Zhang , Yankai Lin , Zhiyuan Liu , Peng Li , Maosong Sun , Jie Zhou

* Findings of ACL 2022 

   Access Paper or Ask Questions

On Transferability of Prompt Tuning for Natural Language Understanding



Yusheng Su , Xiaozhi Wang , Yujia Qin , Chi-Min Chan , Yankai Lin , Zhiyuan Liu , Peng Li , Juanzi Li , Lei Hou , Maosong Sun , Jie Zhou


   Access Paper or Ask Questions

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning



Yujia Qin , Xiaozhi Wang , Yusheng Su , Yankai Lin , Ning Ding , Zhiyuan Liu , Juanzi Li , Lei Hou , Peng Li , Maosong Sun , Jie Zhou


   Access Paper or Ask Questions

bert2BERT: Towards Reusable Pretrained Language Models



Cheng Chen , Yichun Yin , Lifeng Shang , Xin Jiang , Yujia Qin , Fengyu Wang , Zhi Wang , Xiao Chen , Zhiyuan Liu , Qun Liu


   Access Paper or Ask Questions

Knowledge Inheritance for Pre-trained Language Models



Yujia Qin , Yankai Lin , Jing Yi , Jiajie Zhang , Xu Han , Zhengyan Zhang , Yusheng Su , Zhiyuan Liu , Peng Li , Maosong Sun , Jie Zhou

* preprint 

   Access Paper or Ask Questions

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning



Yujia Qin , Yankai Lin , Ryuichi Takanobu , Zhiyuan Liu , Peng Li , Heng Ji , Minlie Huang , Maosong Sun , Jie Zhou

* preprint 

   Access Paper or Ask Questions

1
2
>>