Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta


Jun 22, 2022
Maksim Velikanov, Denis Kuznedelev, Dmitry Yarotsky

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Embedded Ensembles: Infinite Width Limit and Operating Regimes


Feb 24, 2022
Maksim Velikanov, Roman Kail, Ivan Anokhin, Roman Vashurin, Maxim Panov, Alexey Zaytsev, Dmitry Yarotsky

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions


Feb 02, 2022
Maksim Velikanov, Dmitry Yarotsky

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Universal scaling laws in the gradient descent training of neural networks


May 02, 2021
Maksim Velikanov, Dmitry Yarotsky

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email