Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Lifeng Shang

bert2BERT: Towards Reusable Pretrained Language Models


Oct 14, 2021
Cheng Chen, Yichun Yin, Lifeng Shang, Xin Jiang, Yujia Qin, Fengyu Wang, Zhi Wang, Xiao Chen, Zhiyuan Liu, Qun Liu


  Access Paper or Ask Questions

Towards Efficient Post-training Quantization of Pre-trained Language Models


Sep 30, 2021
Haoli Bai, Lu Hou, Lifeng Shang, Xin Jiang, Irwin King, Michael R. Lyu


  Access Paper or Ask Questions

DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling


Sep 22, 2021
Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu

* EMNLP 2021 Long Paper 

  Access Paper or Ask Questions

Improving Unsupervised Question Answering via Summarization-Informed Question Generation


Sep 16, 2021
Chenyang Lyu, Lifeng Shang, Yvette Graham, Jennifer Foster, Xin Jiang, Qun Liu

* EMNLP 2021 Long Paper 

  Access Paper or Ask Questions

Generate & Rank: A Multi-task Framework for Math Word Problems


Sep 07, 2021
Jianhao Shen, Yichun Yin, Lin Li, Lifeng Shang, Xin Jiang, Ming Zhang, Qun Liu

* Findings of EMNLP2021 

  Access Paper or Ask Questions

Integrating Regular Expressions with Neural Networks via DFA


Sep 07, 2021
Shaobo Li, Qun Liu, Xin Jiang, Yichun Yin, Chengjie Sun, Bingquan Liu, Zhenzhou Ji, Lifeng Shang


  Access Paper or Ask Questions

AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models


Jul 29, 2021
Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu

* ACL 2021. The code and models are released at https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/AutoTinyBERT 

  Access Paper or Ask Questions

A Mutual Information Maximization Approach for the Spurious Solution Problem in Weakly Supervised Question Answering


Jun 14, 2021
Zhihong Shao, Lifeng Shang, Qun Liu, Minlie Huang

* ACL2021 main conference 

  Access Paper or Ask Questions

Improved OOD Generalization via Adversarial Training and Pre-training


May 24, 2021
Mingyang Yi, Lu Hou, Jiacheng Sun, Lifeng Shang, Xin Jiang, Qun Liu, Zhi-Ming Ma

* published in ICML2021 

  Access Paper or Ask Questions

Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation


Apr 24, 2021
Cheng Chen, Yichun Yin, Lifeng Shang, Zhi Wang, Xin Jiang, Xiao Chen, Qun Liu


  Access Paper or Ask Questions

Reweighting Augmented Samples by Minimizing the Maximal Expected Loss


Mar 16, 2021
Mingyang Yi, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu, Zhi-Ming Ma

* published in ICLR2021 
* 14 pages 

  Access Paper or Ask Questions

LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation


Mar 11, 2021
Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu


  Access Paper or Ask Questions

Non-invasive Self-attention for Side Information Fusion in Sequential Recommendation


Mar 05, 2021
Chang Liu, Xiaoguang Li, Guohao Cai, Zhenhua Dong, Hong Zhu, Lifeng Shang

* Accepted at AAAI 2021 

  Access Paper or Ask Questions

BinaryBERT: Pushing the Limit of BERT Quantization


Dec 31, 2020
Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King


  Access Paper or Ask Questions

HopRetriever: Retrieve Hops over Wikipedia to Answer Complex Questions


Dec 31, 2020
Shaobo Li, Xiaoguang Li, Lifeng Shang, Xin Jiang, Qun Liu, Chengjie Sun, Zhenzhou Ji, Bingquan Liu

* Accepted at AAAI 2021 

  Access Paper or Ask Questions

Improving Task-Agnostic BERT Distillation with Layer Mapping Search


Dec 11, 2020
Xiaoqi Jiao, Huating Chang, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu


  Access Paper or Ask Questions

TernaryBERT: Distillation-aware Ultra-low Bit BERT


Oct 10, 2020
Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, Qun Liu

* Accepted by EMNLP 2020 

  Access Paper or Ask Questions

Enriching Large-Scale Eventuality Knowledge Graph with Entailment Relations


Jun 21, 2020
Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng, Lifeng Shang

* Accepted by AKBC 2020 

  Access Paper or Ask Questions

DynaBERT: Dynamic BERT with Adaptive Width and Depth


Apr 08, 2020
Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu


  Access Paper or Ask Questions

TinyBERT: Distilling BERT for Natural Language Understanding


Sep 24, 2019
Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu

* 13 pages, 2 figures, 9 tables 

  Access Paper or Ask Questions

Dialog State Tracking with Reinforced Data Augmentation


Aug 21, 2019
Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu

* Under review 

  Access Paper or Ask Questions

Decomposable Neural Paraphrase Generation


Jun 24, 2019
Zichao Li, Xin Jiang, Lifeng Shang, Qun Liu

* To appear in ACL 2019 

  Access Paper or Ask Questions

Meta Learning for Few-shot Keyword Spotting


Dec 26, 2018
Yangbin Chen, Tom Ko, Lifeng Shang, Xiao Chen, Xin Jiang, Qing Li


  Access Paper or Ask Questions

Paraphrase Generation with Deep Reinforcement Learning


Aug 23, 2018
Zichao Li, Xin Jiang, Lifeng Shang, Hang Li

* EMNLP 2018 

  Access Paper or Ask Questions

Neural Machine Translation with Reconstruction


Nov 21, 2016
Zhaopeng Tu, Yang Liu, Lifeng Shang, Xiaohua Liu, Hang Li

* Accepted by AAAI 2017 

  Access Paper or Ask Questions

Neural Generative Question Answering


Apr 22, 2016
Jun Yin, Xin Jiang, Zhengdong Lu, Lifeng Shang, Hang Li, Xiaoming Li

* Accepted by IJCAI 2016 

  Access Paper or Ask Questions

Multimodal Convolutional Neural Networks for Matching Image and Sentence


Aug 29, 2015
Lin Ma, Zhengdong Lu, Lifeng Shang, Hang Li

* Accepted by ICCV 2015 

  Access Paper or Ask Questions

Neural Responding Machine for Short-Text Conversation


Apr 27, 2015
Lifeng Shang, Zhengdong Lu, Hang Li

* accepted as a full paper at ACL 2015 

  Access Paper or Ask Questions