Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for George E. Dahl

What Will it Take to Fix Benchmarking in Natural Language Understanding?


Apr 10, 2021
Samuel R. Bowman, George E. Dahl

* To appear at NAACL 2021 

  Access Paper or Ask Questions

A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes


Feb 16, 2021
Zachary Nado, Justin M. Gilmer, Christopher J. Shallue, Rohan Anil, George E. Dahl


  Access Paper or Ask Questions

On Empirical Comparisons of Optimizers for Deep Learning


Oct 11, 2019
Dami Choi, Christopher J. Shallue, Zachary Nado, Jaehoon Lee, Chris J. Maddison, George E. Dahl


  Access Paper or Ask Questions

Faster Neural Network Training with Data Echoing


Jul 12, 2019
Dami Choi, Alexandre Passos, Christopher J. Shallue, George E. Dahl


  Access Paper or Ask Questions

Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model


Jul 09, 2019
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George E. Dahl, Christopher J. Shallue, Roger Grosse


  Access Paper or Ask Questions

Measuring the Effects of Data Parallelism on Neural Network Training


Nov 21, 2018
Christopher J. Shallue, Jaehoon Lee, Joseph Antognini, Jascha Sohl-Dickstein, Roy Frostig, George E. Dahl

* Submitted to JMLR 

  Access Paper or Ask Questions

The Importance of Generation Order in Language Modeling


Aug 23, 2018
Nicolas Ford, Daniel Duckworth, Mohammad Norouzi, George E. Dahl


  Access Paper or Ask Questions

Motivating the Rules of the Game for Adversarial Example Research


Jul 20, 2018
Justin Gilmer, Ryan P. Adams, Ian Goodfellow, David Andersen, George E. Dahl


  Access Paper or Ask Questions

Embedding Text in Hyperbolic Spaces


Jun 12, 2018
Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl

* TextGraphs 2018 

  Access Paper or Ask Questions

Parallel Architecture and Hyperparameter Search via Successive Halving and Classification


May 25, 2018
Manoj Kumar, George E. Dahl, Vijay Vasudevan, Mohammad Norouzi


  Access Paper or Ask Questions

Large scale distributed neural network training through online distillation


Apr 09, 2018
Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E. Dahl, Geoffrey E. Hinton


  Access Paper or Ask Questions

Neural Message Passing for Quantum Chemistry


Jun 12, 2017
Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

* 14 pages 

  Access Paper or Ask Questions

Detecting Cancer Metastases on Gigapixel Pathology Images


Mar 08, 2017
Yun Liu, Krishna Gadepalli, Mohammad Norouzi, George E. Dahl, Timo Kohlberger, Aleksey Boyko, Subhashini Venugopalan, Aleksei Timofeev, Philip Q. Nelson, Greg S. Corrado, Jason D. Hipp, Lily Peng, Martin C. Stumpe

* Fig 1: normal and tumor patches were accidentally reversed - now fixed. Minor grammatical corrections in appendix, section "Image Color Normalization" 

  Access Paper or Ask Questions

Incorporating Side Information in Probabilistic Matrix Factorization with Gaussian Processes


Aug 09, 2014
Ryan Prescott Adams, George E. Dahl, Iain Murray

* Appears in Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence (UAI2010) 

  Access Paper or Ask Questions

Multi-task Neural Networks for QSAR Predictions


Jun 04, 2014
George E. Dahl, Navdeep Jaitly, Ruslan Salakhutdinov


  Access Paper or Ask Questions

Improvements to deep convolutional neural networks for LVCSR


Dec 10, 2013
Tara N. Sainath, Brian Kingsbury, Abdel-rahman Mohamed, George E. Dahl, George Saon, Hagen Soltau, Tomas Beran, Aleksandr Y. Aravkin, Bhuvana Ramabhadran

* 6 pages, 1 figure 

  Access Paper or Ask Questions

Training Restricted Boltzmann Machines on Word Observations


Jul 05, 2012
George E. Dahl, Ryan P. Adams, Hugo Larochelle


  Access Paper or Ask Questions