Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks


Oct 07, 2022
Daniel Kunin, Atsushi Yamamura, Chao Ma, Surya Ganguli

Add code

* 33 pages, 5 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Rethinking the limiting dynamics of SGD: modified loss, phase space oscillations, and anomalous diffusion


Jul 19, 2021
Daniel Kunin, Javier Sagastuy-Brena, Lauren Gillespie, Eshed Margalit, Hidenori Tanaka, Surya Ganguli, Daniel L. K. Yamins

Add code

* 30 pages, 8 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Noether's Learning Dynamics: The Role of Kinetic Symmetry Breaking in Deep Learning


May 06, 2021
Hidenori Tanaka, Daniel Kunin

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics


Dec 08, 2020
Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel L. K. Yamins, Hidenori Tanaka

Add code

* 28 pages, 17 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Pruning neural networks without any data by iteratively conserving synaptic flow


Jun 09, 2020
Hidenori Tanaka, Daniel Kunin, Daniel L. K. Yamins, Surya Ganguli

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Two Routes to Scalable Credit Assignment without Weight Symmetry


Feb 28, 2020
Daniel Kunin, Aran Nayebi, Javier Sagastuy-Brena, Surya Ganguli, Jon Bloom, Daniel L. K. Yamins

Add code

* 19 pages including supplementary information, 10 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Loss Landscapes of Regularized Linear Autoencoders


Jan 23, 2019
Daniel Kunin, Jonathan M. Bloom, Aleksandrina Goeva, Cotton Seed

Add code

* 11 pages, 8 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email