On Empirical Comparisons of Optimizers for Deep Learning

Oct 11, 2019
Dami Choi, Christopher J. Shallue, Zachary Nado, Jaehoon Lee, Chris J. Maddison, George E. Dahl


  Access Model/Code and Paper
Faster Neural Network Training with Data Echoing

Jul 12, 2019
Dami Choi, Alexandre Passos, Christopher J. Shallue, George E. Dahl


  Access Model/Code and Paper
Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model

Jul 09, 2019
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George E. Dahl, Christopher J. Shallue, Roger Grosse


  Access Model/Code and Paper
Measuring the Effects of Data Parallelism on Neural Network Training

Nov 21, 2018
Christopher J. Shallue, Jaehoon Lee, Joseph Antognini, Jascha Sohl-Dickstein, Roy Frostig, George E. Dahl

* Submitted to JMLR 

  Access Model/Code and Paper
The Importance of Generation Order in Language Modeling

Aug 23, 2018
Nicolas Ford, Daniel Duckworth, Mohammad Norouzi, George E. Dahl


  Access Model/Code and Paper
Motivating the Rules of the Game for Adversarial Example Research

Jul 20, 2018
Justin Gilmer, Ryan P. Adams, Ian Goodfellow, David Andersen, George E. Dahl


  Access Model/Code and Paper
Embedding Text in Hyperbolic Spaces

Jun 12, 2018
Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl

* TextGraphs 2018 

  Access Model/Code and Paper
Parallel Architecture and Hyperparameter Search via Successive Halving and Classification

May 25, 2018
Manoj Kumar, George E. Dahl, Vijay Vasudevan, Mohammad Norouzi


  Access Model/Code and Paper
Large scale distributed neural network training through online distillation

Apr 09, 2018
Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E. Dahl, Geoffrey E. Hinton


  Access Model/Code and Paper
Neural Message Passing for Quantum Chemistry

Jun 12, 2017
Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

* 14 pages 

  Access Model/Code and Paper
Detecting Cancer Metastases on Gigapixel Pathology Images

Mar 08, 2017
Yun Liu, Krishna Gadepalli, Mohammad Norouzi, George E. Dahl, Timo Kohlberger, Aleksey Boyko, Subhashini Venugopalan, Aleksei Timofeev, Philip Q. Nelson, Greg S. Corrado, Jason D. Hipp, Lily Peng, Martin C. Stumpe

* Fig 1: normal and tumor patches were accidentally reversed - now fixed. Minor grammatical corrections in appendix, section "Image Color Normalization" 

  Access Model/Code and Paper
Incorporating Side Information in Probabilistic Matrix Factorization with Gaussian Processes

Aug 09, 2014
Ryan Prescott Adams, George E. Dahl, Iain Murray

* Appears in Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence (UAI2010) 

  Access Model/Code and Paper
Multi-task Neural Networks for QSAR Predictions

Jun 04, 2014
George E. Dahl, Navdeep Jaitly, Ruslan Salakhutdinov


  Access Model/Code and Paper
Improvements to deep convolutional neural networks for LVCSR

Dec 10, 2013
Tara N. Sainath, Brian Kingsbury, Abdel-rahman Mohamed, George E. Dahl, George Saon, Hagen Soltau, Tomas Beran, Aleksandr Y. Aravkin, Bhuvana Ramabhadran

* 6 pages, 1 figure 

  Access Model/Code and Paper
Training Restricted Boltzmann Machines on Word Observations

Jul 05, 2012
George E. Dahl, Ryan P. Adams, Hugo Larochelle


  Access Model/Code and Paper