Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Qi Meng

R-Drop: Regularized Dropout for Neural Networks


Jun 28, 2021
Xiaobo Liang, Lijun Wu, Juntao Li, Yue Wang, Qi Meng, Tao Qin, Wei Chen, Min Zhang, Tie-Yan Liu


  Access Paper or Ask Questions

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior


Jun 11, 2021
Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu

* 16 pages, 5 figures, 7 tables. Audio samples: https://speechresearch.github.io/priorgrad/ 

  Access Paper or Ask Questions

Incorporating NODE with Pre-trained Neural Differential Operator for Learning Dynamics


Jun 09, 2021
Shiqi Gong, Qi Meng, Yue Wang, Lijun Wu, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu

* 15 pages, 12 figures, 3 tables 

  Access Paper or Ask Questions

Machine-Learning Non-Conservative Dynamics for New-Physics Detection


Jun 02, 2021
Ziming Liu, Bohan Wang, Qi Meng, Wei Chen, Max Tegmark, Tie-Yan Liu

* 17 pages, 7 figs, 2 tables; typo correction 

  Access Paper or Ask Questions

UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost


Apr 11, 2021
Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu

* Accepted by NAACL 2021 

  Access Paper or Ask Questions

Towards Accelerating Training of Batch Normalization: A Manifold Perspective


Jan 08, 2021
Mingyang Yi, Qi Meng, Wei Chen, Zhi-Ming Ma


  Access Paper or Ask Questions

The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks


Dec 11, 2020
Bohan Wang, Qi Meng, Wei Chen


  Access Paper or Ask Questions

Dynamic of Stochastic Gradient Descent with State-Dependent Noise


Jul 06, 2020
Qi Meng, Shiqi Gong, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Interpreting Basis Path Set in Neural Networks


Oct 18, 2019
Juanping Zhu, Qi Meng, Wei Chen, Zhi-ming Ma


  Access Paper or Ask Questions

Reinforcement Learning with Dynamic Boltzmann Softmax Updates


Mar 15, 2019
Ling Pan, Qingpeng Cai, Qi Meng, Wei Chen, Longbo Huang, Tie-Yan Liu


  Access Paper or Ask Questions

Positively Scale-Invariant Flatness of ReLU Neural Networks


Mar 06, 2019
Mingyang Yi, Qi Meng, Wei Chen, Zhi-ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space


Oct 09, 2018
Qi Meng, Wei Chen, Shuxin Zheng, Huishuai Zhang, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Target Transfer Q-Learning and Its Convergence Analysis


Sep 21, 2018
Yue Wang, Qi Meng, Wei Cheng, Yuting Liug, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Capacity Control of ReLU Neural Networks by Basis-path Norm


Sep 19, 2018
Shuxin Zheng, Qi Meng, Huishuai Zhang, Wei Chen, Nenghai Yu, Tie-Yan Liu


  Access Paper or Ask Questions

Differential Equations for Modeling Asynchronous Algorithms


May 08, 2018
Li He, Qi Meng, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Convergence Analysis of Distributed Stochastic Gradient Descent with Shuffling


Sep 29, 2017
Qi Meng, Wei Chen, Yue Wang, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Asynchronous Stochastic Gradient Descent with Delay Compensation


Jun 14, 2017
Shuxin Zheng, Qi Meng, Taifeng Wang, Wei Chen, Nenghai Yu, Zhi-Ming Ma, Tie-Yan Liu

* International Conference on Machine Learning. 2017: 4120-4129 
* 20 pages, 5 figures 

  Access Paper or Ask Questions

A Communication-Efficient Parallel Algorithm for Decision Tree


Nov 04, 2016
Qi Meng, Guolin Ke, Taifeng Wang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Asynchronous Stochastic Proximal Optimization Algorithms with Variance Reduction


Sep 27, 2016
Qi Meng, Wei Chen, Jingcheng Yu, Taifeng Wang, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions

Generalization Error Bounds for Optimization Algorithms via Stability


Sep 27, 2016
Qi Meng, Yue Wang, Wei Chen, Taifeng Wang, Zhi-Ming Ma, Tie-Yan Liu


  Access Paper or Ask Questions