Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

A Roadmap for Big Model



Sha Yuan , Hanyu Zhao , Shuai Zhao , Jiahong Leng , Yangxiao Liang , Xiaozhi Wang , Jifan Yu , Xin Lv , Zhou Shao , Jiaao He , Yankai Lin , Xu Han , Zhenghao Liu , Ning Ding , Yongming Rao , Yizhao Gao , Liang Zhang , Ming Ding , Cong Fang , Yisen Wang , Mingsheng Long , Jing Zhang , Yinpeng Dong , Tianyu Pang , Peng Cui , Lingxiao Huang , Zheng Liang , Huawei Shen , Hui Zhang , Quanshi Zhang , Qingxiu Dong , Zhixing Tan , Mingxuan Wang , Shuo Wang , Long Zhou , Haoran Li , Junwei Bao , Yingwei Pan , Weinan Zhang , Zhou Yu , Rui Yan , Chence Shi , Minghao Xu , Zuobai Zhang , Guoqiang Wang , Xiang Pan , Mengjie Li , Xiaoyu Chu , Zijun Yao , Fangwei Zhu , Shulin Cao , Weicheng Xue , Zixuan Ma , Zhengyan Zhang , Shengding Hu , Yujia Qin , Chaojun Xiao , Zheni Zeng , Ganqu Cui , Weize Chen , Weilin Zhao , Yuan Yao , Peng Li , Wenzhao Zheng , Wenliang Zhao , Ziyi Wang , Borui Zhang , Nanyi Fei , Anwen Hu , Zenan Ling , Haoyang Li , Boxi Cao , Xianpei Han , Weidong Zhan , Baobao Chang , Hao Sun , Jiawen Deng , Chujie Zheng , Juanzi Li , Lei Hou , Xigang Cao , Jidong Zhai , Zhiyuan Liu , Maosong Sun , Jiwen Lu , Zhiwu Lu , Qin Jin , Ruihua Song , Ji-Rong Wen , Zhouchen Lin , Liwei Wang , Hang Su , Jun Zhu , Zhifang Sui , Jiajun Zhang , Yang Liu , Xiaodong He , Minlie Huang , Jian Tang , Jie Tang

* arXiv admin note: text overlap with arXiv:2107.06499 by other authors 

   Access Paper or Ask Questions

LEVEN: A Large-Scale Chinese Legal Event Detection Dataset



Feng Yao , Chaojun Xiao , Xiaozhi Wang , Zhiyuan Liu , Lei Hou , Cunchao Tu , Juanzi Li , Yun Liu , Weixing Shen , Maosong Sun

* Accepted to ACL2022 Findings 

   Access Paper or Ask Questions

Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models



Ning Ding , Yujia Qin , Guang Yang , Fuchao Wei , Zonghan Yang , Yusheng Su , Shengding Hu , Yulin Chen , Chi-Min Chan , Weize Chen , Jing Yi , Weilin Zhao , Xiaozhi Wang , Zhiyuan Liu , Hai-Tao Zheng , Jianfei Chen , Yang Liu , Jie Tang , Juanzi Li , Maosong Sun

* 49 pages 

   Access Paper or Ask Questions

CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark



Yuan Yao , Qingxiu Dong , Jian Guan , Boxi Cao , Zhengyan Zhang , Chaojun Xiao , Xiaozhi Wang , Fanchao Qi , Junwei Bao , Jinran Nie , Zheni Zeng , Yuxian Gu , Kun Zhou , Xuancheng Huang , Wenhao Li , Shuhuai Ren , Jinliang Lu , Chengqiang Xu , Huadong Wang , Guoyang Zeng , Zile Zhou , Jiajun Zhang , Juanzi Li , Minlie Huang , Rui Yan , Xiaodong He , Xiaojun Wan , Xin Zhao , Xu Sun , Yang Liu , Zhiyuan Liu , Xianpei Han , Erhong Yang , Zhifang Sui , Maosong Sun


   Access Paper or Ask Questions

Doppler velocity-based algorithm for Clustering and Velocity Estimation of moving objects



Mian Guo , Kai Zhong , Xiaozhi Wang

* 7 pages, 9 figures, 2 tables, 2 algorithms, CACRE2022 

   Access Paper or Ask Questions

On Transferability of Prompt Tuning for Natural Language Understanding



Yusheng Su , Xiaozhi Wang , Yujia Qin , Chi-Min Chan , Yankai Lin , Zhiyuan Liu , Peng Li , Juanzi Li , Lei Hou , Maosong Sun , Jie Zhou


   Access Paper or Ask Questions

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning



Yujia Qin , Xiaozhi Wang , Yusheng Su , Yankai Lin , Ning Ding , Zhiyuan Liu , Juanzi Li , Lei Hou , Peng Li , Maosong Sun , Jie Zhou


   Access Paper or Ask Questions

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining



Chenglei Si , Zhengyan Zhang , Yingfa Chen , Fanchao Qi , Xiaozhi Wang , Zhiyuan Liu , Maosong Sun

* Work in progress. Feedback is welcome 

   Access Paper or Ask Questions

CLEVE: Contrastive Pre-training for Event Extraction



Ziqi Wang , Xiaozhi Wang , Xu Han , Yankai Lin , Lei Hou , Zhiyuan Liu , Peng Li , Juanzi Li , Jie Zhou

* Accepted at ACL 2021 

   Access Paper or Ask Questions

1
2
>>