Picture for Avital Oliver

Avital Oliver

Scaling Vision Transformers to 22 Billion Parameters

Feb 10, 2023
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey Gritsenko, Vighnesh Birodkar, Cristina Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetić, Dustin Tran, Thomas Kipf, Mario Lučić, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby

Figure 1 for Scaling Vision Transformers to 22 Billion Parameters

Figure 2 for Scaling Vision Transformers to 22 Billion Parameters

Figure 3 for Scaling Vision Transformers to 22 Billion Parameters

Figure 4 for Scaling Vision Transformers to 22 Billion Parameters

Access Paper or Ask Questions

Milking CowMask for Semi-Supervised Image Classification

Apr 03, 2020
Geoff French, Avital Oliver, Tim Salimans

Figure 1 for Milking CowMask for Semi-Supervised Image Classification

Figure 2 for Milking CowMask for Semi-Supervised Image Classification

Figure 3 for Milking CowMask for Semi-Supervised Image Classification

Figure 4 for Milking CowMask for Semi-Supervised Image Classification

* 10 pages, 3 figured, submitted to ICML 2020

Access Paper or Ask Questions

Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

Oct 26, 2018
Avital Oliver, Augustus Odena, Colin Raffel, Ekin D. Cubuk, Ian J. Goodfellow

Figure 1 for Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

Figure 2 for Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

Figure 3 for Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

Figure 4 for Realistic Evaluation of Deep Semi-Supervised Learning Algorithms

* NIPS 2018 Proceedings

Access Paper or Ask Questions