Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting


Jul 14, 2022
Neil Mallinar, James B. Simon, Amirhesam Abedsoltan, Parthe Pandit, Mikhail Belkin, Preetum Nakkiran

* NM and JB co-first authors 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Limitations of the NTK for Understanding Generalization in Deep Learning


Jun 20, 2022
Nikhil Vyas, Yamini Bansal, Preetum Nakkiran


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

What You See is What You Get: Distributional Generalization for Algorithm Design in Deep Learning


Apr 07, 2022
Bogdan Kulynych, Yao-Yuan Yang, Yaodong Yu, Jarosław Błasiok, Preetum Nakkiran

* First two authors contributed equally 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Knowledge Distillation: Bad Models Can Be Good Role Models


Mar 28, 2022
Gal Kaplun, Eran Malach, Preetum Nakkiran, Shai Shalev-Shwartz


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Deconstructing Distributions: A Pointwise Framework of Learning


Feb 20, 2022
Gal Kaplun, Nikhil Ghosh, Saurabh Garg, Boaz Barak, Preetum Nakkiran

* GK and NG contributed equally 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Limitations of Neural Collapse for Understanding Generalization in Deep Learning


Feb 17, 2022
Like Hui, Mikhail Belkin, Preetum Nakkiran


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Turing-Universal Learners with Optimal Scaling Laws


Nov 09, 2021
Preetum Nakkiran


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Revisiting Model Stitching to Compare Neural Representations


Jun 14, 2021
Yamini Bansal, Preetum Nakkiran, Boaz Barak


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

The Deep Bootstrap: Good Online Learners are Good Offline Generalizers


Oct 16, 2020
Preetum Nakkiran, Behnam Neyshabur, Hanie Sedghi


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Distributional Generalization: A New Kind of Generalization


Sep 17, 2020
Preetum Nakkiran, Yamini Bansal

* PN, YB co-first authors 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
>>