Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Hidenori Tanaka

Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion


Jul 19, 2021
Daniel Kunin, Javier Sagastuy-Brena, Lauren Gillespie, Eshed Margalit, Hidenori Tanaka, Surya Ganguli, Daniel L. K. Yamins

* 30 pages, 8 figures 

  Access Paper or Ask Questions

Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning


Jul 08, 2021
Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka


  Access Paper or Ask Questions

Noether's Learning Dynamics: The Role of Kinetic Symmetry Breaking in Deep Learning


May 06, 2021
Hidenori Tanaka, Daniel Kunin


  Access Paper or Ask Questions

Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics


Dec 08, 2020
Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel L. K. Yamins, Hidenori Tanaka

* 28 pages, 17 figures 

  Access Paper or Ask Questions

Pruning neural networks without any data by iteratively conserving synaptic flow


Jun 09, 2020
Hidenori Tanaka, Daniel Kunin, Daniel L. K. Yamins, Surya Ganguli


  Access Paper or Ask Questions

From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction


Dec 12, 2019
Hidenori Tanaka, Aran Nayebi, Niru Maheswaranathan, Lane McIntosh, Stephen A. Baccus, Surya Ganguli

* Neural Information Processing Systems (NeurIPS), 2019 

  Access Paper or Ask Questions