Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

 CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
Di He
A Cross-Level Information Transmission Network for Predicting Phenotype from New Genotype: Application to Cancer Precision Medicine

Oct 09, 2020
Di He, Lei Xie


  Access Paper or Ask Questions
GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training

Sep 07, 2020
Tianle Cai, Shengjie Luo, Keyulu Xu, Di He, Tie-yan Liu, Liwei Wang


  Access Paper or Ask Questions
Variance-reduced Language Pretraining via a Mask Proposal Network

Aug 12, 2020
Liang Chen, Tianyuan Zhang, Di He, Guolin Ke, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions
Taking Notes on the Fly Helps BERT Pre-training

Aug 04, 2020
Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu

* Qiyu Wu and Chen Xing contribute equally 
  Access Paper or Ask Questions
Transferred Discrepancy: Quantifying the Difference Between Representations

Jul 24, 2020
Yunzhen Feng, Runtian Zhai, Di He, Liwei Wang, Bin Dong

* 23 pages, 3 figures 
  Access Paper or Ask Questions
Rethinking Positional Encoding in Language Pre-training

Jul 09, 2020
Guolin Ke, Di He, Tie-Yan Liu

* refine writing; update down-stream results due to bug fix 
  Access Paper or Ask Questions
Rethinking the Positional Encoding in Language Pre-training

Jun 28, 2020
Guolin Ke, Di He, Tie-Yan Liu


  Access Paper or Ask Questions
MC-BERT: Efficient Language Pre-Training via a Meta Controller

Jun 16, 2020
Zhenhui Xu, Linyuan Gong, Guolin Ke, Di He, Shuxin Zheng, Liwei Wang, Jiang Bian, Tie-Yan Liu


  Access Paper or Ask Questions
Invertible Image Rescaling

May 12, 2020
Mingqing Xiao, Shuxin Zheng, Chang Liu, Yaolong Wang, Di He, Guolin Ke, Jiang Bian, Zhouchen Lin, Tie-Yan Liu


  Access Paper or Ask Questions
Incorporating BERT into Neural Machine Translation

Feb 17, 2020
Jinhua Zhu, Yingce Xia, Lijun Wu, Di He, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu

* Accepted to ICLR-2020 
  Access Paper or Ask Questions
MACER: Attack-free and Scalable Robust Training via Maximizing Certified Radius

Feb 15, 2020
Runtian Zhai, Chen Dan, Di He, Huan Zhang, Boqing Gong, Pradeep Ravikumar, Cho-Jui Hsieh, Liwei Wang

* In ICLR 2020. 20 Pages 
  Access Paper or Ask Questions
On Layer Normalization in the Transformer Architecture

Feb 12, 2020
Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions
Defective Convolutional Layers Learn Robust CNNs

Nov 19, 2019
Tiange Luo, Tianle Cai, Mengxiao Zhang, Siyu Chen, Di He, Liwei Wang


  Access Paper or Ask Questions
Fast Structured Decoding for Sequence Models

Oct 25, 2019
Zhiqing Sun, Zhuohan Li, Haoqing Wang, Zi Lin, Di He, Zhi-Hong Deng

* Accepted to NeurIPS 2019 (Previous title: Structured Decoding for Non-Autoregressive Machine Translation) 
  Access Paper or Ask Questions
On the Anomalous Generalization of GANs

Oct 06, 2019
Jinchen Xuan, Yunchang Yang, Ze Yang, Di He, Liwei Wang


  Access Paper or Ask Questions
Hint-Based Training for Non-Autoregressive Machine Translation

Sep 15, 2019
Zhuohan Li, Zi Lin, Di He, Fei Tian, Tao Qin, Liwei Wang, Tie-Yan Liu

* EMNLP-IJCNLP 2019 
  Access Paper or Ask Questions
Multilingual Neural Machine Translation with Language Clustering

Aug 25, 2019
Xu Tan, Jiale Chen, Di He, Yingce Xia, Tao Qin, Tie-Yan Liu

* Accepted by EMNLP 2019 
  Access Paper or Ask Questions
Representation Degeneration Problem in Training Natural Language Generation Models

Jul 28, 2019
Jun Gao, Di He, Xu Tan, Tao Qin, Liwei Wang, Tie-Yan Liu

* ICLR 2019 
  Access Paper or Ask Questions
Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View

Jun 06, 2019
Yiping Lu, Zhuohan Li, Di He, Zhiqing Sun, Bin Dong, Tao Qin, Liwei Wang, Tie-Yan Liu


  Access Paper or Ask Questions
Adversarially Robust Generalization Just Requires More Unlabeled Data

Jun 03, 2019
Runtian Zhai, Tianle Cai, Di He, Chen Dan, Kun He, John Hopcroft, Liwei Wang

* 16 pages. Submitted to NeurIPS 2019 
  Access Paper or Ask Questions
A Gram-Gauss-Newton Method Learning Overparameterized Deep Neural Networks for Regression Problems

May 28, 2019
Tianle Cai, Ruiqi Gao, Jikai Hou, Siyu Chen, Dong Wang, Di He, Zhihua Zhang, Liwei Wang

* Submitted to NeurIPS 2019 
  Access Paper or Ask Questions
Multilingual Neural Machine Translation with Knowledge Distillation

Feb 28, 2019
Xu Tan, Yi Ren, Di He, Tao Qin, Zhou Zhao, Tie-Yan Liu

* Accepted by ICLR 2019 
  Access Paper or Ask Questions
Non-Autoregressive Machine Translation with Auxiliary Regularization

Feb 22, 2019
Yiren Wang, Fei Tian, Di He, Tao Qin, ChengXiang Zhai, Tie-Yan Liu

* AAAI 2019 
  Access Paper or Ask Questions
Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input

Dec 23, 2018
Junliang Guo, Xu Tan, Di He, Tao Qin, Linli Xu, Tie-Yan Liu

* AAAI 2019 
  Access Paper or Ask Questions
Sentence-wise Smooth Regularization for Sequence to Sequence Learning

Dec 12, 2018
Chengyue Gong, Xu Tan, Di He, Tao Qin

* AAAI 2019 
  Access Paper or Ask Questions