Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations


Apr 25, 2023
Shashank Shekhar, Florian Bordes, Pascal Vincent, Ari Morcos

Add code


   Access Paper or Ask Questions

Stable and low-precision training for large-scale vision-language models


Apr 25, 2023
Mitchell Wortsman, Tim Dettmers, Luke Zettlemoyer, Ari Morcos, Ali Farhadi, Ludwig Schmidt

Add code


   Access Paper or Ask Questions

A Cookbook of Self-Supervised Learning


Apr 24, 2023
Randall Balestriero, Mark Ibrahim, Vlad Sobal, Ari Morcos, Shashank Shekhar, Tom Goldstein, Florian Bordes, Adrien Bardes, Gregoire Mialon, Yuandong Tian, Avi Schwarzschild, Andrew Gordon Wilson, Jonas Geiping, Quentin Garrido, Pierre Fernandez, Amir Bar, Hamed Pirsiavash, Yann LeCun, Micah Goldblum

Add code


   Access Paper or Ask Questions

The Robustness Limits of SoTA Vision Models to Natural Variation


Oct 24, 2022
Mark Ibrahim, Quentin Garrido, Ari Morcos, Diane Bouchacourt

Add code


   Access Paper or Ask Questions

Robust Self-Supervised Learning with Lie Groups


Oct 24, 2022
Mark Ibrahim, Diane Bouchacourt, Ari Morcos

Add code


   Access Paper or Ask Questions

Trade-offs of Local SGD at Scale: An Empirical Study


Oct 15, 2021
Jose Javier Gonzalez Ortiz, Jonathan Frankle, Mike Rabbat, Ari Morcos, Nicolas Ballas

Add code


   Access Paper or Ask Questions

Transformed CNNs: recasting pre-trained convolutional layers with self-attention


Jun 10, 2021
Stéphane d'Ascoli, Levent Sagun, Giulio Biroli, Ari Morcos

Add code


   Access Paper or Ask Questions

ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases


Mar 19, 2021
Stéphane d'Ascoli, Hugo Touvron, Matthew Leavitt, Ari Morcos, Giulio Biroli, Levent Sagun

Add code


   Access Paper or Ask Questions

Towards falsifiable interpretability research


Oct 22, 2020
Matthew L. Leavitt, Ari Morcos

Add code


   Access Paper or Ask Questions

Linking average- and worst-case perturbation robustness via class selectivity and dimensionality


Oct 14, 2020
Matthew L. Leavitt, Ari Morcos

Add code

* arXiv admin note: text overlap with arXiv:2007.04440 

   Access Paper or Ask Questions

1
2
>>