Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Parameter Re-Initialization through Cyclical Batch Size Schedules


Dec 04, 2018
Norman Mu, Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney

Add code

* Presented in Systems for Machine Learning Workshop at NeurIPS'18 conference 

   Access Paper or Ask Questions

On the Computational Inefficiency of Large Batch Sizes for Stochastic Gradient Descent


Nov 30, 2018
Noah Golmant, Nikita Vemuri, Zhewei Yao, Vladimir Feinberg, Amir Gholami, Kai Rothauge, Michael W. Mahoney, Joseph Gonzalez

Add code


   Access Paper or Ask Questions

Large batch size training of neural networks with adversarial training and second-order information


Oct 02, 2018
Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney

Add code

* 17 pages 

   Access Paper or Ask Questions

Hessian-based Analysis of Large Batch Training and Robustness to Adversaries


Jun 18, 2018
Zhewei Yao, Amir Gholami, Qi Lei, Kurt Keutzer, Michael W. Mahoney

Add code

* 23 pages, 16 figures 

   Access Paper or Ask Questions

<<
1
2
3
4
5