Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit


Jul 18, 2022
Boaz Barak, Benjamin L. Edelman, Surbhi Goel, Sham Kakade, Eran Malach, Cyril Zhang

Add code


   Access Paper or Ask Questions

Inductive Biases and Variable Creation in Self-Attention Mechanisms


Oct 19, 2021
Benjamin L. Edelman, Surbhi Goel, Sham Kakade, Cyril Zhang

Add code


   Access Paper or Ask Questions

SGD on Neural Networks Learns Functions of Increasing Complexity


May 28, 2019
Preetum Nakkiran, Gal Kaplun, Dimitris Kalimeris, Tristan Yang, Benjamin L. Edelman, Fred Zhang, Boaz Barak

Add code

* Submitted to NeurIPS 2019 

   Access Paper or Ask Questions