Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Shuxin Zheng

Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding

Jun 23, 2021
Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu

* Preprint. Work in Progress 

  Access Paper or Ask Questions

First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track

Jun 20, 2021
Chengxuan Ying, Mingqi Yang, Shuxin Zheng, Guolin Ke, Shengjie Luo, Tianle Cai, Chenglin Wu, Yuxin Wang, Yanming Shen, Di He

  Access Paper or Ask Questions

Do Transformers Really Perform Bad for Graph Representation?

Jun 17, 2021
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, Tie-Yan Liu

  Access Paper or Ask Questions

How could Neural Networks understand Programs?

May 31, 2021
Dinglan Peng, Shuxin Zheng, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu

* ICML 2021 

  Access Paper or Ask Questions

Revisiting Language Encoding in Learning Multilingual Representations

Feb 16, 2021
Shengjie Luo, Kaiyuan Gao, Shuxin Zheng, Guolin Ke, Di He, Liwei Wang, Tie-Yan Liu

  Access Paper or Ask Questions

Modeling Lost Information in Lossy Image Compression

Jul 08, 2020
Yaolong Wang, Mingqing Xiao, Chang Liu, Shuxin Zheng, Tie-Yan Liu

  Access Paper or Ask Questions

MC-BERT: Efficient Language Pre-Training via a Meta Controller

Jun 16, 2020
Zhenhui Xu, Linyuan Gong, Guolin Ke, Di He, Shuxin Zheng, Liwei Wang, Jiang Bian, Tie-Yan Liu

  Access Paper or Ask Questions

Invertible Image Rescaling

May 12, 2020
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, Tie-Yan Liu

  Access Paper or Ask Questions

Cross-Iteration Batch Normalization

Feb 14, 2020
Zhuliang Yao, Yue Cao, Shuxin Zheng, Gao Huang, Stephen Lin

  Access Paper or Ask Questions

On Layer Normalization in the Transformer Architecture

Feb 12, 2020
Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, Tie-Yan Liu

  Access Paper or Ask Questions

$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space

Oct 09, 2018
Qi Meng, Wei Chen, Shuxin Zheng, Huishuai Zhang, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu

  Access Paper or Ask Questions

Capacity Control of ReLU Neural Networks by Basis-path Norm

Sep 19, 2018
Shuxin Zheng, Qi Meng, Huishuai Zhang, Wei Chen, Nenghai Yu, Tie-Yan Liu

  Access Paper or Ask Questions

Asynchronous Stochastic Gradient Descent with Delay Compensation

Jun 14, 2017
Shuxin Zheng, Qi Meng, Taifeng Wang, Wei Chen, Nenghai Yu, Zhi-Ming Ma, Tie-Yan Liu

* International Conference on Machine Learning. 2017: 4120-4129 
* 20 pages, 5 figures 

  Access Paper or Ask Questions