Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Guolin Ke

Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding


Jun 23, 2021
Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu

* Preprint. Work in Progress 

  Access Paper or Ask Questions

First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track


Jun 20, 2021
Chengxuan Ying, Mingqi Yang, Shuxin Zheng, Guolin Ke, Shengjie Luo, Tianle Cai, Chenglin Wu, Yuxin Wang, Yanming Shen, Di He


  Access Paper or Ask Questions

Do Transformers Really Perform Bad for Graph Representation?


Jun 17, 2021
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, Tie-Yan Liu


  Access Paper or Ask Questions

Deep Subdomain Adaptation Network for Image Classification


Jun 17, 2021
Yongchun Zhu, Fuzhen Zhuang, Jindong Wang, Guolin Ke, Jingwu Chen, Jiang Bian, Hui Xiong, Qing He

* published on TNNLS 

  Access Paper or Ask Questions

How could Neural Networks understand Programs?


May 31, 2021
Dinglan Peng, Shuxin Zheng, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu

* ICML 2021 

  Access Paper or Ask Questions

Transformers with Competitive Ensembles of Independent Mechanisms


Feb 27, 2021
Alex Lamb, Di He, Anirudh Goyal, Guolin Ke, Chien-Feng Liao, Mirco Ravanelli, Yoshua Bengio

* Under Review, ICML 2021 

  Access Paper or Ask Questions

LazyFormer: Self Attention with Lazy Update


Feb 25, 2021
Chengxuan Ying, Guolin Ke, Di He, Tie-Yan Liu


  Access Paper or Ask Questions

Less is More: Pre-training a Strong Siamese Encoder Using a Weak Decoder


Feb 18, 2021
Shuqi Lu, Chenyan Xiong, Di He, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tieyan Liu, Arnold Overwijk


  Access Paper or Ask Questions

Revisiting Language Encoding in Learning Multilingual Representations


Feb 16, 2021
Shengjie Luo, Kaiyuan Gao, Shuxin Zheng, Guolin Ke, Di He, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions

Variance-reduced Language Pretraining via a Mask Proposal Network


Aug 12, 2020
Liang Chen, Tianyuan Zhang, Di He, Guolin Ke, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions

Taking Notes on the Fly Helps BERT Pre-training


Aug 04, 2020
Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu

* Qiyu Wu and Chen Xing contribute equally 

  Access Paper or Ask Questions

Rethinking Positional Encoding in Language Pre-training


Jul 09, 2020
Guolin Ke, Di He, Tie-Yan Liu

* refine writing; update down-stream results due to bug fix 

  Access Paper or Ask Questions

Rethinking the Positional Encoding in Language Pre-training


Jun 28, 2020
Guolin Ke, Di He, Tie-Yan Liu


  Access Paper or Ask Questions

MC-BERT: Efficient Language Pre-Training via a Meta Controller


Jun 16, 2020
Zhenhui Xu, Linyuan Gong, Guolin Ke, Di He, Shuxin Zheng, Liwei Wang, Jiang Bian, Tie-Yan Liu


  Access Paper or Ask Questions

Invertible Image Rescaling


May 12, 2020
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, Tie-Yan Liu


  Access Paper or Ask Questions

LightMC: A Dynamic and Efficient Multiclass Decomposition Algorithm


Aug 25, 2019
Ziyu Liu, Guolin Ke, Jiang Bian, Tieyan Liu

* 10 pages, 2 figures 

  Access Paper or Ask Questions

Light Multi-segment Activation for Model Compression


Jul 16, 2019
Zhenhui Xu, Guolin Ke, Jia Zhang, Jiang Bian, Tie-Yan Liu


  Access Paper or Ask Questions

Multi-task Learning for Financial Forecasting


Sep 27, 2018
Tao Ma, Guolin Ke

* Submitted to AAAI 2019 

  Access Paper or Ask Questions

A Communication-Efficient Parallel Algorithm for Decision Tree


Nov 04, 2016
Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions