Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Guolin Ke

Transformers with Competitive Ensembles of Independent Mechanisms


Feb 27, 2021
Alex Lamb, Di He, Anirudh Goyal, Guolin Ke, Chien-Feng Liao, Mirco Ravanelli, Yoshua Bengio

* Under Review, ICML 2021 

  Access Paper or Ask Questions

LazyFormer: Self Attention with Lazy Update


Feb 25, 2021
Chengxuan Ying, Guolin Ke, Di He, Tie-Yan Liu


  Access Paper or Ask Questions

Less is More: Pre-training a Strong Siamese Encoder Using a Weak Decoder


Feb 18, 2021
Shuqi Lu, Chenyan Xiong, Di He, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tieyan Liu, Arnold Overwijk


  Access Paper or Ask Questions

Revisiting Language Encoding in Learning Multilingual Representations


Feb 16, 2021
Shengjie Luo, Kaiyuan Gao, Shuxin Zheng, Guolin Ke, Di He, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions

Variance-reduced Language Pretraining via a Mask Proposal Network


Aug 12, 2020
Liang Chen, Tianyuan Zhang, Di He, Guolin Ke, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions

Taking Notes on the Fly Helps BERT Pre-training


Aug 04, 2020
Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu

* Qiyu Wu and Chen Xing contribute equally 

  Access Paper or Ask Questions

Rethinking Positional Encoding in Language Pre-training


Jul 09, 2020
Guolin Ke, Di He, Tie-Yan Liu

* refine writing; update down-stream results due to bug fix 

  Access Paper or Ask Questions

Rethinking the Positional Encoding in Language Pre-training


Jun 28, 2020
Guolin Ke, Di He, Tie-Yan Liu


  Access Paper or Ask Questions

MC-BERT: Efficient Language Pre-Training via a Meta Controller


Jun 16, 2020
Zhenhui Xu, Linyuan Gong, Guolin Ke, Di He, Shuxin Zheng, Liwei Wang, Jiang Bian, Tie-Yan Liu


  Access Paper or Ask Questions

Invertible Image Rescaling


May 12, 2020
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, Tie-Yan Liu


  Access Paper or Ask Questions

LightMC: A Dynamic and Efficient Multiclass Decomposition Algorithm


Aug 25, 2019
Ziyu Liu, Guolin Ke, Jiang Bian, Tieyan Liu

* 10 pages, 2 figures 

  Access Paper or Ask Questions

Light Multi-segment Activation for Model Compression


Jul 16, 2019
Zhenhui Xu, Guolin Ke, Jia Zhang, Jiang Bian, Tie-Yan Liu


  Access Paper or Ask Questions

Multi-task Learning for Financial Forecasting


Sep 27, 2018
Tao Ma, Guolin Ke

* Submitted to AAAI 2019 

  Access Paper or Ask Questions

A Communication-Efficient Parallel Algorithm for Decision Tree


Nov 04, 2016
Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions