Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints

Oct 02, 2020
Guodong Zhang, Xuchan Bao, Laurent Lessard, Roger Grosse

* 36 pages 

  Access Paper or Ask Questions

On the Suboptimality of Negative Momentum for Minimax Optimization

Aug 17, 2020
Guodong Zhang, Yuanhao Wang

* 23 pages 

  Access Paper or Ask Questions

Picking Winning Tickets Before Training by Preserving Gradient Flow

Feb 18, 2020
Chaoqi Wang, Guodong Zhang, Roger Grosse

* In Proceedings of the 8th International Conference on Learning Representations (ICLR), 2020 
* Accepted at ICLR 2020 

  Access Paper or Ask Questions

On Solving Minimax Optimization Locally: A Follow-the-Ridge Approach

Nov 25, 2019
Yuanhao Wang, Guodong Zhang, Jimmy Ba

* 21 pages 

  Access Paper or Ask Questions

Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model

Jul 09, 2019
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George E. Dahl, Christopher J. Shallue, Roger Grosse


  Access Paper or Ask Questions

Benchmarking Model-Based Reinforcement Learning

Jul 03, 2019
Tingwu Wang, Xuchan Bao, Ignasi Clavera, Jerrick Hoang, Yeming Wen, Eric Langlois, Shunshi Zhang, Guodong Zhang, Pieter Abbeel, Jimmy Ba

* 8 main pages, 8 figures; 14 appendix pages, 25 figures 

  Access Paper or Ask Questions

Fast Convergence of Natural Gradient Descent for Overparameterized Neural Networks

May 27, 2019
Guodong Zhang, James Martens, Roger Grosse


  Access Paper or Ask Questions

EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis

May 15, 2019
Chaoqi Wang, Roger Grosse, Sanja Fidler, Guodong Zhang

* ICML 2019 

  Access Paper or Ask Questions

Interplay Between Optimization and Generalization of Stochastic Gradient Descent with Covariance Noise

Apr 03, 2019
Yeming Wen, Kevin Luk, Maxime Gazeau, Guodong Zhang, Harris Chan, Jimmy Ba


  Access Paper or Ask Questions

Functional Variational Bayesian Neural Networks

Mar 14, 2019
Shengyang Sun, Guodong Zhang, Jiaxin Shi, Roger Grosse

* ICLR 2019 

  Access Paper or Ask Questions

Eigenvalue Corrected Noisy Natural Gradient

Nov 30, 2018
Juhan Bae, Guodong Zhang, Roger Grosse


  Access Paper or Ask Questions

Three Mechanisms of Weight Decay Regularization

Oct 29, 2018
Guodong Zhang, Chaoqi Wang, Bowen Xu, Roger Grosse


  Access Paper or Ask Questions

Differentiable Compositional Kernel Learning for Gaussian Processes

Aug 05, 2018
Shengyang Sun, Guodong Zhang, Chaoqi Wang, Wenyuan Zeng, Jiaman Li, Roger Grosse

* ICML 2018; update proof 

  Access Paper or Ask Questions

Noisy Natural Gradient as Variational Inference

Feb 26, 2018
Guodong Zhang, Shengyang Sun, David Duvenaud, Roger Grosse


  Access Paper or Ask Questions

Deformable Convolutional Networks

Jun 05, 2017
Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, Yichen Wei


  Access Paper or Ask Questions