Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Zhiyuan Liu

CPM-2: Large-scale Cost-effective Pre-trained Language Models


Jun 23, 2021
Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu, Maosong Sun


  Access Paper or Ask Questions

Evaluating Modules in Graph Contrastive Learning


Jun 15, 2021
Ganqu Cui, Yufeng Du, Cheng Yang, Jie Zhou, Liang Xu, Lifeng Wang, Zhiyuan Liu


  Access Paper or Ask Questions

Pre-Trained Models: Past, Present and Future


Jun 15, 2021
Xu Han, Zhengyan Zhang, Ning Ding, Yuxian Gu, Xiao Liu, Yuqi Huo, Jiezhong Qiu, Liang Zhang, Wentao Han, Minlie Huang, Qin Jin, Yanyan Lan, Yang Liu, Zhiyuan Liu, Zhiwu Lu, Xipeng Qiu, Ruihua Song, Jie Tang, Ji-Rong Wen, Jinhui Yuan, Wayne Xin Zhao, Jun Zhu


  Access Paper or Ask Questions

Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution


Jun 11, 2021
Fanchao Qi, Yuan Yao, Sophia Xu, Zhiyuan Liu, Maosong Sun

* Accepted by the main conference of ACL-IJCNLP as a long paper. Camera-ready version 

  Access Paper or Ask Questions

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger


Jun 03, 2021
Fanchao Qi, Mukai Li, Yangyi Chen, Zhengyan Zhang, Zhiyuan Liu, Yasheng Wang, Maosong Sun

* Accepted by ACL-IJCNLP 2021 as a long paper. Camera-ready version 

  Access Paper or Ask Questions

Automatic Construction of Sememe Knowledge Bases via Dictionaries


Jun 03, 2021
Fanchao Qi, Yangyi Chen, Fengyu Wang, Zhiyuan Liu, Xiao Chen, Maosong Sun

* Accepted by Findings of ACL at ACL-IJCNLP 2021. Camera-ready version 

  Access Paper or Ask Questions

Few-NERD: A Few-Shot Named Entity Recognition Dataset


Jun 02, 2021
Ning Ding, Guangwei Xu, Yulin Chen, Xiaobin Wang, Xu Han, Pengjun Xie, Hai-Tao Zheng, Zhiyuan Liu

* Accepted by ACL-IJCNLP 2021 (long paper) 

  Access Paper or Ask Questions

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining


Jun 01, 2021
Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun

* Work in progress. Feedback is welcome 

  Access Paper or Ask Questions

Fully Hyperbolic Neural Networks


May 31, 2021
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou


  Access Paper or Ask Questions

PTR: Prompt Tuning with Rules for Text Classification


May 31, 2021
Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, Maosong Sun


  Access Paper or Ask Questions

CLEVE: Contrastive Pre-training for Event Extraction


May 30, 2021
Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li, Jie Zhou

* Accepted at ACL 2021 

  Access Paper or Ask Questions

Knowledge Inheritance for Pre-trained Language Models


May 28, 2021
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* preprint 

  Access Paper or Ask Questions

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction


May 20, 2021
Tianyu Gao, Xu Han, Keyue Qiu, Yuzhuo Bai, Zhiyu Xie, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* ACL 2021 Findings 

  Access Paper or Ask Questions

Few-Shot Conversational Dense Retrieval


May 19, 2021
Shi Yu, Zhenghao Liu, Chenyan Xiong, Tao Feng, Zhiyuan Liu

* Accepted by SIGIR 2021 

  Access Paper or Ask Questions

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents


May 09, 2021
Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, Maosong Sun


  Access Paper or Ask Questions

Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability


Apr 14, 2021
Xin Lv, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Yichi Zhang, Zelin Dai


  Access Paper or Ask Questions

Incentivizing Exploration in Linear Bandits under Information Gap


Apr 08, 2021
Huazheng Wang, Haifeng Xu, Chuanhao Li, Zhiyuan Liu, Hongning Wang


  Access Paper or Ask Questions

Visual Distant Supervision for Scene Graph Generation


Mar 29, 2021
Yuan Yao, Ao Zhang, Xu Han, Mengdi Li, Cornelius Weber, Zhiyuan Liu, Stefan Wermter, Maosong Sun

* 14 pages, 6 figures 

  Access Paper or Ask Questions

Equality before the Law: Legal Judgment Consistency Analysis for Fairness


Mar 25, 2021
Yuzhong Wang, Chaojun Xiao, Shirong Ma, Haoxi Zhong, Cunchao Tu, Tianyang Zhang, Zhiyuan Liu, Maosong Sun

* 15 pages, 4 figures, 10 tables 

  Access Paper or Ask Questions

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models


Mar 03, 2021
Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions

UPRec: User-Aware Pre-training for Recommender Systems


Feb 22, 2021
Chaojun Xiao, Ruobing Xie, Yuan Yao, Zhiyuan Liu, Maosong Sun, Xu Zhang, Leyu Lin

* This paper has been submitted to IEEE TKDE 

  Access Paper or Ask Questions

Representation Learning for Natural Language Processing


Feb 07, 2021
Zhiyuan Liu, Yankai Lin, Maosong Sun

* Published in Springer 

  Access Paper or Ask Questions