Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

How Does Adaptive Optimization Impact Local Neural Network Geometry?


Nov 04, 2022
Kaiqi Jiang, Dhruv Malik, Yuanzhi Li

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Vision Transformers provably learn spatial structure


Oct 13, 2022
Samy Jelassi, Michael E. Sander, Yuanzhi Li

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Dissecting adaptive methods in GANs


Oct 09, 2022
Samy Jelassi, David Dobre, Arthur Mensch, Yuanzhi Li, Gauthier Gidel

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions


Oct 04, 2022
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, Anru R. Zhang

Add code

* 30 pages 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Towards Understanding Mixture of Experts in Deep Learning


Aug 04, 2022
Zixiang Chen, Yihe Deng, Yue Wu, Quanquan Gu, Yuanzhi Li

Add code

* 53 pages, 8 figures, 11 tables 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Towards understanding how momentum improves generalization in deep learning


Jul 13, 2022
Samy Jelassi, Yuanzhi Li

Add code

* Accepted at ICML 2022 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Learning (Very) Simple Generative Models Is Hard


May 31, 2022
Sitan Chen, Jerry Li, Yuanzhi Li

Add code

* 24 pages, 2 figures 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning


May 14, 2022
Zixin Wen, Yuanzhi Li

Add code

* 88 pages, comments welcome 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Complete Policy Regret Bounds for Tallying Bandits


Apr 24, 2022
Dhruv Malik, Yuanzhi Li, Aarti Singh

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
3
4
5
6
7
>>