Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon


Jun 13, 2022
Vimal Thilak, Etai Littwin, Shuangfei Zhai, Omid Saremi, Roni Paiss, Joshua Susskind

Add code

* Removed Tex formatting commands in title Title and Abstract 

   Access Paper or Ask Questions

Implicit Greedy Rank Learning in Autoencoders via Overparameterized Linear Networks


Jul 02, 2021
Shih-Yu Sun, Vimal Thilak, Etai Littwin, Omid Saremi, Joshua M. Susskind

Add code


   Access Paper or Ask Questions

Implicit Acceleration and Feature Learning in Infinitely Wide Neural Networks with Bottlenecks


Jul 02, 2021
Etai Littwin, Omid Saremi, Shuangfei Zhai, Vimal Thilak, Hanlin Goh, Joshua M. Susskind, Greg Yang

Add code


   Access Paper or Ask Questions