Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for George E. Dahl

Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approach

Dec 16, 2021
Setareh Ariafar, Justin Gilmer, Zachary Nado, Jasper Snoek, Rodolphe Jenatton, George E. Dahl

  Access Paper or Ask Questions

Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers

Sep 16, 2021
Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zack Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

  Access Paper or Ask Questions

What Will it Take to Fix Benchmarking in Natural Language Understanding?

Apr 10, 2021
Samuel R. Bowman, George E. Dahl

* To appear at NAACL 2021 

  Access Paper or Ask Questions

A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes

Feb 16, 2021
Zachary Nado, Justin M. Gilmer, Christopher J. Shallue, Rohan Anil, George E. Dahl

  Access Paper or Ask Questions

On Empirical Comparisons of Optimizers for Deep Learning

Oct 11, 2019
Dami Choi, Christopher J. Shallue, Zachary Nado, Jaehoon Lee, Chris J. Maddison, George E. Dahl

  Access Paper or Ask Questions

Faster Neural Network Training with Data Echoing

Jul 12, 2019
Dami Choi, Alexandre Passos, Christopher J. Shallue, George E. Dahl

  Access Paper or Ask Questions

Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model

Jul 09, 2019
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George E. Dahl, Christopher J. Shallue, Roger Grosse

  Access Paper or Ask Questions

Measuring the Effects of Data Parallelism on Neural Network Training

Nov 21, 2018
Christopher J. Shallue, Jaehoon Lee, Joseph Antognini, Jascha Sohl-Dickstein, Roy Frostig, George E. Dahl

* Submitted to JMLR 

  Access Paper or Ask Questions

The Importance of Generation Order in Language Modeling

Aug 23, 2018
Nicolas Ford, Daniel Duckworth, Mohammad Norouzi, George E. Dahl

  Access Paper or Ask Questions

Motivating the Rules of the Game for Adversarial Example Research

Jul 20, 2018
Justin Gilmer, Ryan P. Adams, Ian Goodfellow, David Andersen, George E. Dahl

  Access Paper or Ask Questions

Embedding Text in Hyperbolic Spaces

Jun 12, 2018
Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl

* TextGraphs 2018 

  Access Paper or Ask Questions

Parallel Architecture and Hyperparameter Search via Successive Halving and Classification

May 25, 2018
Manoj Kumar, George E. Dahl, Vijay Vasudevan, Mohammad Norouzi

  Access Paper or Ask Questions

Large scale distributed neural network training through online distillation

Apr 09, 2018
Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E. Dahl, Geoffrey E. Hinton

  Access Paper or Ask Questions

Neural Message Passing for Quantum Chemistry

Jun 12, 2017
Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

* 14 pages 

  Access Paper or Ask Questions

Detecting Cancer Metastases on Gigapixel Pathology Images

Mar 08, 2017
Yun Liu, Krishna Gadepalli, Mohammad Norouzi, George E. Dahl, Timo Kohlberger, Aleksey Boyko, Subhashini Venugopalan, Aleksei Timofeev, Philip Q. Nelson, Greg S. Corrado, Jason D. Hipp, Lily Peng, Martin C. Stumpe

* Fig 1: normal and tumor patches were accidentally reversed - now fixed. Minor grammatical corrections in appendix, section "Image Color Normalization" 

  Access Paper or Ask Questions

Incorporating Side Information in Probabilistic Matrix Factorization with Gaussian Processes

Aug 09, 2014
Ryan Prescott Adams, George E. Dahl, Iain Murray

* Appears in Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence (UAI2010) 

  Access Paper or Ask Questions

Multi-task Neural Networks for QSAR Predictions

Jun 04, 2014
George E. Dahl, Navdeep Jaitly, Ruslan Salakhutdinov

  Access Paper or Ask Questions

Improvements to deep convolutional neural networks for LVCSR

Dec 10, 2013
Tara N. Sainath, Brian Kingsbury, Abdel-rahman Mohamed, George E. Dahl, George Saon, Hagen Soltau, Tomas Beran, Aleksandr Y. Aravkin, Bhuvana Ramabhadran

* 6 pages, 1 figure 

  Access Paper or Ask Questions

Training Restricted Boltzmann Machines on Word Observations

Jul 05, 2012
George E. Dahl, Ryan P. Adams, Hugo Larochelle

  Access Paper or Ask Questions