Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Ibrahim Alabdulmohsin

Ibrahim Alabdulmohsin

Scaling Vision Transformers to 22 Billion Parameters

Feb 10, 2023
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey Gritsenko, Vighnesh Birodkar, Cristina Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetić, Dustin Tran, Thomas Kipf, Mario Lučić, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby

Figure 1 for Scaling Vision Transformers to 22 Billion Parameters

Figure 2 for Scaling Vision Transformers to 22 Billion Parameters

Figure 3 for Scaling Vision Transformers to 22 Billion Parameters

Figure 4 for Scaling Vision Transformers to 22 Billion Parameters

Access Paper or Ask Questions

Adapting to Latent Subgroup Shifts via Concepts and Proxies

Dec 21, 2022
Ibrahim Alabdulmohsin, Nicole Chiou, Alexander D'Amour, Arthur Gretton, Sanmi Koyejo, Matt J. Kusner, Stephen R. Pfohl, Olawale Salaudeen, Jessica Schrouff, Katherine Tsai

Figure 1 for Adapting to Latent Subgroup Shifts via Concepts and Proxies

Figure 2 for Adapting to Latent Subgroup Shifts via Concepts and Proxies

Figure 3 for Adapting to Latent Subgroup Shifts via Concepts and Proxies

Figure 4 for Adapting to Latent Subgroup Shifts via Concepts and Proxies

* Authors listed in alphabetical order

Access Paper or Ask Questions

FlexiViT: One Model for All Patch Sizes

Dec 15, 2022
Lucas Beyer, Pavel Izmailov, Alexander Kolesnikov, Mathilde Caron, Simon Kornblith, Xiaohua Zhai, Matthias Minderer, Michael Tschannen, Ibrahim Alabdulmohsin, Filip Pavetic

Figure 1 for FlexiViT: One Model for All Patch Sizes

Figure 2 for FlexiViT: One Model for All Patch Sizes

Figure 3 for FlexiViT: One Model for All Patch Sizes

Figure 4 for FlexiViT: One Model for All Patch Sizes

* Code and pre-trained models available at https://github.com/google-research/big_vision. All authors made significant technical contributions

Access Paper or Ask Questions

Layer-Stack Temperature Scaling

Nov 18, 2022
Amr Khalifa, Michael C. Mozer, Hanie Sedghi, Behnam Neyshabur, Ibrahim Alabdulmohsin

Figure 1 for Layer-Stack Temperature Scaling

Figure 2 for Layer-Stack Temperature Scaling

Figure 3 for Layer-Stack Temperature Scaling

Figure 4 for Layer-Stack Temperature Scaling

* 10 pages, 7 figures, 3 tables

Access Paper or Ask Questions

A Reduction to Binary Approach for Debiasing Multiclass Datasets

May 31, 2022
Ibrahim Alabdulmohsin, Jessica Schrouff, Oluwasanmi Koyejo

Figure 1 for A Reduction to Binary Approach for Debiasing Multiclass Datasets

Figure 2 for A Reduction to Binary Approach for Debiasing Multiclass Datasets

Figure 3 for A Reduction to Binary Approach for Debiasing Multiclass Datasets

Figure 4 for A Reduction to Binary Approach for Debiasing Multiclass Datasets

* 18 pages, 5 figures

Access Paper or Ask Questions

The Impact of Reinitialization on Generalization in Convolutional Neural Networks

Sep 01, 2021
Ibrahim Alabdulmohsin, Hartmut Maennel, Daniel Keysers

Figure 1 for The Impact of Reinitialization on Generalization in Convolutional Neural Networks

Figure 2 for The Impact of Reinitialization on Generalization in Convolutional Neural Networks

Figure 3 for The Impact of Reinitialization on Generalization in Convolutional Neural Networks

Figure 4 for The Impact of Reinitialization on Generalization in Convolutional Neural Networks

* 12 figures, 7 tables

Access Paper or Ask Questions