Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Guy Gur-Ari

Are wider nets better given the same number of parameters?

Oct 27, 2020
Anna Golubeva, Behnam Neyshabur, Guy Gur-Ari

* 9 pages 

  Access Paper or Ask Questions

On the training dynamics of deep networks with $L_2$ regularization

Jun 15, 2020
Aitor Lewkowycz, Guy Gur-Ari

* 10+12 pages, 5+10 figures 

  Access Paper or Ask Questions

On the asymptotics of wide networks with polynomial activations

Jun 11, 2020
Kyle Aitken, Guy Gur-Ari

* 8+12 pages, 6 figures, 2 tables 

  Access Paper or Ask Questions

The large learning rate phase of deep learning: the catapult mechanism

Mar 04, 2020
Aitor Lewkowycz, Yasaman Bahri, Ethan Dyer, Jascha Sohl-Dickstein, Guy Gur-Ari

* 25 pages, 19 figures 

  Access Paper or Ask Questions

Wider Networks Learn Better Features

Sep 25, 2019
Dar Gilboa, Guy Gur-Ari

  Access Paper or Ask Questions

Asymptotics of Wide Networks from Feynman Diagrams

Sep 25, 2019
Ethan Dyer, Guy Gur-Ari

* 10 pages, 3 figures, 1 Table + Appendices 

  Access Paper or Ask Questions

Gradient Descent Happens in a Tiny Subspace

Dec 12, 2018
Guy Gur-Ari, Daniel A. Roberts, Ethan Dyer

* 9 pages + appendices, 12 figures 

  Access Paper or Ask Questions