Alert button
Picture for George E. Dahl

George E. Dahl

Alert button

Benchmarking Neural Network Training Algorithms

Jun 12, 2023
George E. Dahl, Frank Schneider, Zachary Nado, Naman Agarwal, Chandramouli Shama Sastry, Philipp Hennig, Sourabh Medapati, Runa Eschenhagen, Priya Kasimbeg, Daniel Suo, Juhan Bae, Justin Gilmer, Abel L. Peirson, Bilal Khan, Rohan Anil, Mike Rabbat, Shankar Krishnan, Daniel Snider, Ehsan Amid, Kongtao Chen, Chris J. Maddison, Rakshith Vasudev, Michal Badura, Ankush Garg, Peter Mattson

Figure 1 for Benchmarking Neural Network Training Algorithms
Figure 2 for Benchmarking Neural Network Training Algorithms
Figure 3 for Benchmarking Neural Network Training Algorithms
Figure 4 for Benchmarking Neural Network Training Algorithms
Viaarxiv icon

Adaptive Gradient Methods at the Edge of Stability

Jul 29, 2022
Jeremy M. Cohen, Behrooz Ghorbani, Shankar Krishnan, Naman Agarwal, Sourabh Medapati, Michal Badura, Daniel Suo, David Cardoze, Zachary Nado, George E. Dahl, Justin Gilmer

Figure 1 for Adaptive Gradient Methods at the Edge of Stability
Figure 2 for Adaptive Gradient Methods at the Edge of Stability
Figure 3 for Adaptive Gradient Methods at the Edge of Stability
Figure 4 for Adaptive Gradient Methods at the Edge of Stability
Viaarxiv icon

Pre-training helps Bayesian optimization too

Jul 07, 2022
Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zachary Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

Figure 1 for Pre-training helps Bayesian optimization too
Figure 2 for Pre-training helps Bayesian optimization too
Figure 3 for Pre-training helps Bayesian optimization too
Figure 4 for Pre-training helps Bayesian optimization too
Viaarxiv icon

AI system for fetal ultrasound in low-resource settings

Mar 18, 2022
Ryan G. Gomes, Bellington Vwalika, Chace Lee, Angelica Willis, Marcin Sieniek, Joan T. Price, Christina Chen, Margaret P. Kasaro, James A. Taylor, Elizabeth M. Stringer, Scott Mayer McKinney, Ntazana Sindano, George E. Dahl, William Goodnight III, Justin Gilmer, Benjamin H. Chi, Charles Lau, Terry Spitz, T Saensuksopa, Kris Liu, Jonny Wong, Rory Pilgrim, Akib Uddin, Greg Corrado, Lily Peng, Katherine Chou, Daniel Tse, Jeffrey S. A. Stringer, Shravya Shetty

Figure 1 for AI system for fetal ultrasound in low-resource settings
Figure 2 for AI system for fetal ultrasound in low-resource settings
Figure 3 for AI system for fetal ultrasound in low-resource settings
Figure 4 for AI system for fetal ultrasound in low-resource settings
Viaarxiv icon

Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach

Dec 16, 2021
Setareh Ariafar, Justin Gilmer, Zachary Nado, Jasper Snoek, Rodolphe Jenatton, George E. Dahl

Figure 1 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 2 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 3 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Figure 4 for Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach
Viaarxiv icon

Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers

Sep 16, 2021
Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zack Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

Figure 1 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 2 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 3 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Figure 4 for Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
Viaarxiv icon

What Will it Take to Fix Benchmarking in Natural Language Understanding?

Apr 10, 2021
Samuel R. Bowman, George E. Dahl

Figure 1 for What Will it Take to Fix Benchmarking in Natural Language Understanding?
Viaarxiv icon

A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes

Feb 16, 2021
Zachary Nado, Justin M. Gilmer, Christopher J. Shallue, Rohan Anil, George E. Dahl

Figure 1 for A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Figure 2 for A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Figure 3 for A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Figure 4 for A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Viaarxiv icon

On Empirical Comparisons of Optimizers for Deep Learning

Oct 11, 2019
Dami Choi, Christopher J. Shallue, Zachary Nado, Jaehoon Lee, Chris J. Maddison, George E. Dahl

Figure 1 for On Empirical Comparisons of Optimizers for Deep Learning
Figure 2 for On Empirical Comparisons of Optimizers for Deep Learning
Figure 3 for On Empirical Comparisons of Optimizers for Deep Learning
Figure 4 for On Empirical Comparisons of Optimizers for Deep Learning
Viaarxiv icon