Picture for Vivek Ramanujan

Vivek Ramanujan

DataComp: In search of the next generation of multimodal datasets

May 03, 2023
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt

Figure 1 for DataComp: In search of the next generation of multimodal datasets

Figure 2 for DataComp: In search of the next generation of multimodal datasets

Figure 3 for DataComp: In search of the next generation of multimodal datasets

Figure 4 for DataComp: In search of the next generation of multimodal datasets

Access Paper or Ask Questions

Neural Radiance Field Codebooks

Jan 10, 2023
Matthew Wallingford, Aditya Kusupati, Alex Fang, Vivek Ramanujan, Aniruddha Kembhavi, Roozbeh Mottaghi, Ali Farhadi

Figure 1 for Neural Radiance Field Codebooks

Figure 2 for Neural Radiance Field Codebooks

Figure 3 for Neural Radiance Field Codebooks

Figure 4 for Neural Radiance Field Codebooks

* 19 pages, 8 figures, 9 tables

Access Paper or Ask Questions

Matryoshka Representations for Adaptive Deployment

Jun 01, 2022
Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi

Figure 1 for Matryoshka Representations for Adaptive Deployment

Figure 2 for Matryoshka Representations for Adaptive Deployment

Figure 3 for Matryoshka Representations for Adaptive Deployment

Figure 4 for Matryoshka Representations for Adaptive Deployment

* 32 pages, 11 figures Edits: Fixed details about adaptive classification

Access Paper or Ask Questions

Forward Compatible Training for Representation Learning

Dec 06, 2021
Vivek Ramanujan, Pavan Kumar Anasosalu Vasu, Ali Farhadi, Oncel Tuzel, Hadi Pouransari

Figure 1 for Forward Compatible Training for Representation Learning

Figure 2 for Forward Compatible Training for Representation Learning

Figure 3 for Forward Compatible Training for Representation Learning

Figure 4 for Forward Compatible Training for Representation Learning

* 14 pages with appendix

Access Paper or Ask Questions

Parameter Norm Growth During Training of Transformers

Nov 11, 2020
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah Smith

Figure 1 for Parameter Norm Growth During Training of Transformers

Figure 2 for Parameter Norm Growth During Training of Transformers

Figure 3 for Parameter Norm Growth During Training of Transformers

Figure 4 for Parameter Norm Growth During Training of Transformers

* Preprint. 9 body pages with appendix

Access Paper or Ask Questions