Alert button
Picture for Runzhe Wang

Runzhe Wang

Alert button

The Marginal Value of Momentum for Small Learning Rate SGD

Jul 27, 2023
Runzhe Wang, Sadhika Malladi, Tianhao Wang, Kaifeng Lyu, Zhiyuan Li

Figure 1 for The Marginal Value of Momentum for Small Learning Rate SGD
Figure 2 for The Marginal Value of Momentum for Small Learning Rate SGD
Figure 3 for The Marginal Value of Momentum for Small Learning Rate SGD
Viaarxiv icon

Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias

Nov 09, 2021
Kaifeng Lyu, Zhiyuan Li, Runzhe Wang, Sanjeev Arora

Figure 1 for Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias
Figure 2 for Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias
Figure 3 for Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias
Figure 4 for Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias
Viaarxiv icon

Going Beyond Linear RL: Sample Efficient Neural Function Approximation

Jul 14, 2021
Baihe Huang, Kaixuan Huang, Sham M. Kakade, Jason D. Lee, Qi Lei, Runzhe Wang, Jiaqi Yang

Figure 1 for Going Beyond Linear RL: Sample Efficient Neural Function Approximation
Figure 2 for Going Beyond Linear RL: Sample Efficient Neural Function Approximation
Viaarxiv icon

Optimal Gradient-based Algorithms for Non-concave Bandit Optimization

Jul 09, 2021
Baihe Huang, Kaixuan Huang, Sham M. Kakade, Jason D. Lee, Qi Lei, Runzhe Wang, Jiaqi Yang

Figure 1 for Optimal Gradient-based Algorithms for Non-concave Bandit Optimization
Figure 2 for Optimal Gradient-based Algorithms for Non-concave Bandit Optimization
Viaarxiv icon

Mildly Overparametrized Neural Nets can Memorize Training Data Efficiently

Sep 26, 2019
Rong Ge, Runzhe Wang, Haoyu Zhao

Figure 1 for Mildly Overparametrized Neural Nets can Memorize Training Data Efficiently
Figure 2 for Mildly Overparametrized Neural Nets can Memorize Training Data Efficiently
Figure 3 for Mildly Overparametrized Neural Nets can Memorize Training Data Efficiently
Figure 4 for Mildly Overparametrized Neural Nets can Memorize Training Data Efficiently
Viaarxiv icon