Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Peng Li

MoEfication: Conditional Computation of Transformer Models for Efficient Inference


Oct 15, 2021
Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou


  Access Paper or Ask Questions

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning


Oct 15, 2021
Yujia Qin, Xiaozhi Wang, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou


  Access Paper or Ask Questions

RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models


Oct 15, 2021
Wenkai Yang, Yankai Lin, Peng Li, Jie Zhou, Xu Sun

* EMNLP 2021 (main conference), long paper, camera-ready version 

  Access Paper or Ask Questions

Topology-Imbalance Learning for Semi-Supervised Node Classification


Oct 08, 2021
Deli Chen, Yankai Lin, Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun

* Accepted By NeurIPS 2021 

  Access Paper or Ask Questions

Dynamic Knowledge Distillation for Pre-trained Language Models


Sep 23, 2021
Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun

* Main Conference EMNLP 2021, Camera Ready 

  Access Paper or Ask Questions

Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation


Sep 17, 2021
Feilong Chen, Fandong Meng, Xiuyi Chen, Peng Li, Jie Zhou

* ACL Fingdings 2021 

  Access Paper or Ask Questions

GoG: Relation-aware Graph-over-Graph Network for Visual Dialog


Sep 17, 2021
Feilong Chen, Xiuyi Chen, Fandong Meng, Peng Li, Jie Zhou

* ACL Findings 2021. arXiv admin note: text overlap with arXiv:2109.06013 

  Access Paper or Ask Questions

WeChat Neural Machine Translation Systems for WMT21


Aug 05, 2021
Xianfeng Zeng, Yijin Liu, Ernan Li, Qiu Ran, Fandong Meng, Peng Li, Jinan Xu, Jie Zhou

* Submitted to WMT 2021 as a system paper 

  Access Paper or Ask Questions

Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization


Aug 04, 2021
Wenrui Zhang, Peng Li

* 20 pages, 7 figures 

  Access Paper or Ask Questions

H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks


Jul 25, 2021
Ling Liang, Zheng Qu, Zhaodong Chen, Fengbin Tu, Yujie Wu, Lei Deng, Guoqi Li, Peng Li, Yuan Xie


  Access Paper or Ask Questions

Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks


Jun 22, 2021
Yukun Yang, Wenrui Zhang, Peng Li

* Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021 

  Access Paper or Ask Questions

Demonstration of Panda: A Weakly Supervised Entity Matching System


Jun 21, 2021
Renzhi Wu, Prem Sakala, Peng Li, Xu Chu, Yeye He

* vldb 2021 demo 
* video can be found at https://chu-data-lab.cc.gatech.edu/ml-for-data-integration/ 

  Access Paper or Ask Questions

Fully Hyperbolic Neural Networks


May 31, 2021
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou


  Access Paper or Ask Questions

CLEVE: Contrastive Pre-training for Event Extraction


May 30, 2021
Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li, Jie Zhou

* Accepted at ACL 2021 

  Access Paper or Ask Questions

Knowledge Inheritance for Pre-trained Language Models


May 28, 2021
Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* preprint 

  Access Paper or Ask Questions

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction


May 20, 2021
Tianyu Gao, Xu Han, Keyue Qiu, Yuzhuo Bai, Zhiyu Xie, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

* ACL 2021 Findings 

  Access Paper or Ask Questions

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models


Mar 03, 2021
Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun


  Access Paper or Ask Questions

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning


Dec 30, 2020
Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou

* preprint 

  Access Paper or Ask Questions

Accelerating Pre-trained Language Models via Calibrated Cascade


Dec 29, 2020
Lei Li, Yankai Lin, Shuhuai Ren, Deli Chen, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun

* Preprint 

  Access Paper or Ask Questions

EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications


Nov 23, 2020
Minghui Qiu, Peng Li, Hanjie Pan, Chengyu Wang, Ang Wang, Cen Chen, Yaliang Li, Dehong Gao, Jun Huang, Yong Li, Jun Yang, Deng Cai, Wei Lin

* 4 pages 

  Access Paper or Ask Questions

Using simulation to incorporate dynamic criteria into multiple criteria decision-making


Nov 16, 2020
Uwe Aickelin, Jenna Marie Reps, Peer-Olaf Siebers, Peng Li

* Journal of the Operational Research Society, Volume 69, Issue 7, Pages 1021-1032 

  Access Paper or Ask Questions

DisenE: Disentangling Knowledge Graph Embeddings


Nov 12, 2020
Xiaoyu Kou, Yankai Lin, Yuntao Li, Jiahao Xu, Peng Li, Jie Zhou, Yan Zhang

* There are some mistakes in the paper 

  Access Paper or Ask Questions

Skip-Connected Self-Recurrent Spiking Neural Networks with Joint Intrinsic Parameter and Synaptic Weight Training


Oct 23, 2020
Wenrui Zhang, Peng Li

* 9 pages, 3 figures 

  Access Paper or Ask Questions

MS-Ranker: Accumulating Evidence from Potentially Correct Candidates for Answer Selection


Oct 10, 2020
Yingxue Zhang, Fandong Meng, Peng Li, Ping Jian, Jie Zhou


  Access Paper or Ask Questions

Disentangle-based Continual Graph Representation Learning


Oct 06, 2020
Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou, Yan Zhang


  Access Paper or Ask Questions

WeChat Neural Machine Translation Systems for WMT20


Oct 05, 2020
Fandong Meng, Jianhao Yan, Yijin Liu, Yuan Gao, Xianfeng Zeng, Qinsong Zeng, Peng Li, Ming Chen, Jie Zhou, Sifan Liu, Hao Zhou

* Accepted at WMT 2020. Our Chinese to English system achieved the highest case-sensitive BLEU score among all submissions 

  Access Paper or Ask Questions

Learning from Context or Names? An Empirical Study on Neural Relation Extraction


Oct 05, 2020
Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun, Jie Zhou

* Accepted by EMNLP 2020 

  Access Paper or Ask Questions