Alert button
Picture for Qi Meng

Qi Meng

Alert button

Towards Accelerating Training of Batch Normalization: A Manifold Perspective

Jan 08, 2021
Mingyang Yi, Qi Meng, Wei Chen, Zhi-Ming Ma

Figure 1 for Towards Accelerating Training of Batch Normalization: A Manifold Perspective
Figure 2 for Towards Accelerating Training of Batch Normalization: A Manifold Perspective
Figure 3 for Towards Accelerating Training of Batch Normalization: A Manifold Perspective
Figure 4 for Towards Accelerating Training of Batch Normalization: A Manifold Perspective
Viaarxiv icon

The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks

Dec 11, 2020
Bohan Wang, Qi Meng, Wei Chen

Figure 1 for The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Figure 2 for The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Figure 3 for The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Figure 4 for The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Viaarxiv icon

Dynamic of Stochastic Gradient Descent with State-Dependent Noise

Jul 06, 2020
Qi Meng, Shiqi Gong, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu

Figure 1 for Dynamic of Stochastic Gradient Descent with State-Dependent Noise
Figure 2 for Dynamic of Stochastic Gradient Descent with State-Dependent Noise
Figure 3 for Dynamic of Stochastic Gradient Descent with State-Dependent Noise
Figure 4 for Dynamic of Stochastic Gradient Descent with State-Dependent Noise
Viaarxiv icon

Interpreting Basis Path Set in Neural Networks

Oct 18, 2019
Juanping Zhu, Qi Meng, Wei Chen, Zhi-ming Ma

Figure 1 for Interpreting Basis Path Set in Neural Networks
Figure 2 for Interpreting Basis Path Set in Neural Networks
Figure 3 for Interpreting Basis Path Set in Neural Networks
Figure 4 for Interpreting Basis Path Set in Neural Networks
Viaarxiv icon

Reinforcement Learning with Dynamic Boltzmann Softmax Updates

Mar 15, 2019
Ling Pan, Qingpeng Cai, Qi Meng, Wei Chen, Longbo Huang, Tie-Yan Liu

Figure 1 for Reinforcement Learning with Dynamic Boltzmann Softmax Updates
Figure 2 for Reinforcement Learning with Dynamic Boltzmann Softmax Updates
Figure 3 for Reinforcement Learning with Dynamic Boltzmann Softmax Updates
Figure 4 for Reinforcement Learning with Dynamic Boltzmann Softmax Updates
Viaarxiv icon

Positively Scale-Invariant Flatness of ReLU Neural Networks

Mar 06, 2019
Mingyang Yi, Qi Meng, Wei Chen, Zhi-ming Ma, Tie-Yan Liu

Figure 1 for Positively Scale-Invariant Flatness of ReLU Neural Networks
Figure 2 for Positively Scale-Invariant Flatness of ReLU Neural Networks
Figure 3 for Positively Scale-Invariant Flatness of ReLU Neural Networks
Viaarxiv icon

$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space

Oct 09, 2018
Qi Meng, Wei Chen, Shuxin Zheng, Huishuai Zhang, Qiwei Ye, Zhi-Ming Ma, Tie-Yan Liu

Figure 1 for $\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space
Figure 2 for $\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space
Figure 3 for $\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space
Figure 4 for $\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space
Viaarxiv icon

Target Transfer Q-Learning and Its Convergence Analysis

Sep 21, 2018
Yue Wang, Qi Meng, Wei Cheng, Yuting Liug, Zhi-Ming Ma, Tie-Yan Liu

Figure 1 for Target Transfer Q-Learning and Its Convergence Analysis
Viaarxiv icon

Capacity Control of ReLU Neural Networks by Basis-path Norm

Sep 19, 2018
Shuxin Zheng, Qi Meng, Huishuai Zhang, Wei Chen, Nenghai Yu, Tie-Yan Liu

Figure 1 for Capacity Control of ReLU Neural Networks by Basis-path Norm
Figure 2 for Capacity Control of ReLU Neural Networks by Basis-path Norm
Figure 3 for Capacity Control of ReLU Neural Networks by Basis-path Norm
Figure 4 for Capacity Control of ReLU Neural Networks by Basis-path Norm
Viaarxiv icon