Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Beyond neural scaling laws: beating power law scaling via data pruning


Jun 29, 2022
Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, Ari S. Morcos

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time


Mar 10, 2022
Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt

Add code

* The last three authors contributed equally 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Grounding inductive biases in natural images:invariance stems from variations in data


Jun 09, 2021
Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Width Transfer: On the (In)variance of Width Optimization


Apr 24, 2021
Ting-Wu Chin, Diana Marculescu, Ari S. Morcos

Add code

* Full paper accepted at CVPR Workshops 2021; a 4-page abridged version is accepted at ICLR 2021 NAS Workshop 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Leveraging background augmentations to encourage semantic focus in self-supervised contrastive learning


Mar 23, 2021
Chaitanya K. Ryali, David J. Schwab, Ari S. Morcos

Add code

* Technical Report 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Reservoir Transformer


Dec 30, 2020
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Are all negatives created equal in contrastive instance discrimination?


Oct 25, 2020
Tiffany Tianhui Cai, Jonathan Frankle, David J. Schwab, Ari S. Morcos

Add code

* Fixed author name error 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

PareCO: Pareto-aware Channel Optimization for Slimmable Neural Networks


Jul 23, 2020
Ting-Wu Chin, Ari S. Morcos, Diana Marculescu

Add code

* preprint, 4-page abridged versions have been accepted at non-archival venues including RealML and DMMLSys workshops at ICML'20 and DLP-KDD and AdvML workshops at KDD'20 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

On the relationship between class selectivity, dimensionality, and robustness


Jul 08, 2020
Matthew L. Leavitt, Ari S. Morcos

Add code


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
3
>>