Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Maosong Sun

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models


Oct 08, 2021
Yuan Yao, Ao Zhang, Zhengyan Zhang, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun

* Work in progress 

  Access Paper or Ask Questions

MoEfication: Conditional Computation of Transformer Models for Efficient Inference


Oct 05, 2021
Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* Work in progress 

  Access Paper or Ask Questions

Pack Together: Entity and Relation Extraction with Levitated Marker


Sep 13, 2021
Deming Ye, Yankai Lin, Maosong Sun


  Access Paper or Ask Questions

Lingxi: A Diversity-aware Chinese Modern Poetry Generation System


Aug 27, 2021
Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li


  Access Paper or Ask Questions

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification


Aug 04, 2021
Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Juanzi Li, Maosong Sun


  Access Paper or Ask Questions

Language Models are Good Translators


Jun 25, 2021
Shuo Wang, Zhaopeng Tu, Zhixing Tan, Wenxuan Wang, Maosong Sun, Yang Liu

* 12 pages. Work in progress. An earlier verison of this manuscript is under review 

  Access Paper or Ask Questions

CPM-2: Large-scale Cost-effective Pre-trained Language Models


Jun 24, 2021
Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu, Maosong Sun


  Access Paper or Ask Questions

Alternated Training with Synthetic and Authentic Data for Neural Machine Translation


Jun 16, 2021
Rui Jiao, Zonghan Yang, Maosong Sun, Yang Liu

* ACL 2021, Short Findings 

  Access Paper or Ask Questions

Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution


Jun 11, 2021
Fanchao Qi, Yuan Yao, Sophia Xu, Zhiyuan Liu, Maosong Sun

* Accepted by the main conference of ACL-IJCNLP as a long paper. Camera-ready version 

  Access Paper or Ask Questions

On the Language Coverage Bias for Neural Machine Translation


Jun 07, 2021
Shuo Wang, Zhaopeng Tu, Zhixing Tan, Shuming Shi, Maosong Sun, Yang Liu

* ACL 2021, Long Findings 

  Access Paper or Ask Questions

CCPM: A Chinese Classical Poetry Matching Dataset


Jun 03, 2021
Wenhao Li, Fanchao Qi, Maosong Sun, Xiaoyuan Yi, Jiarui Zhang


  Access Paper or Ask Questions

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger


Jun 03, 2021
Fanchao Qi, Mukai Li, Yangyi Chen, Zhengyan Zhang, Zhiyuan Liu, Yasheng Wang, Maosong Sun

* Accepted by ACL-IJCNLP 2021 as a long paper. Camera-ready version 

  Access Paper or Ask Questions

Automatic Construction of Sememe Knowledge Bases via Dictionaries


Jun 03, 2021
Fanchao Qi, Yangyi Chen, Fengyu Wang, Zhiyuan Liu, Xiao Chen, Maosong Sun

* Accepted by Findings of ACL at ACL-IJCNLP 2021. Camera-ready version 

  Access Paper or Ask Questions

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining


Jun 01, 2021
Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun

* Work in progress. Feedback is welcome 

  Access Paper or Ask Questions

Transfer Learning for Sequence Generation: from Single-source to Multi-source


May 31, 2021
Xuancheng Huang, Jingfang Xu, Maosong Sun, Yang Liu

* ACL2021 main track long paper 

  Access Paper or Ask Questions

Fully Hyperbolic Neural Networks


May 31, 2021
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou


  Access Paper or Ask Questions

PTR: Prompt Tuning with Rules for Text Classification


May 31, 2021
Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, Maosong Sun


  Access Paper or Ask Questions

Knowledge Inheritance for Pre-trained Language Models


May 28, 2021
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* preprint 

  Access Paper or Ask Questions

TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference


May 25, 2021
Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun

* Accepted by NAACL2021 

  Access Paper or Ask Questions

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction


May 20, 2021
Tianyu Gao, Xu Han, Keyue Qiu, Yuzhuo Bai, Zhiyu Xie, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* ACL 2021 Findings 

  Access Paper or Ask Questions

Dynamic Multi-Branch Layers for On-Device Neural Machine Translation


May 14, 2021
Zhixing Tan, Maosong Sun, Yang Liu


  Access Paper or Ask Questions

Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction


May 10, 2021
Zhenghao Liu, Xiaoyuan Yi, Maosong Sun, Liner Yang, Tat-Seng Chua

* Accepted by NAACL2021, 9 pages, 5 figures 

  Access Paper or Ask Questions

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents


May 09, 2021
Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, Maosong Sun


  Access Paper or Ask Questions

Visual Distant Supervision for Scene Graph Generation


Mar 29, 2021
Yuan Yao, Ao Zhang, Xu Han, Mengdi Li, Cornelius Weber, Zhiyuan Liu, Stefan Wermter, Maosong Sun

* 14 pages, 6 figures 

  Access Paper or Ask Questions