Alert button
Picture for Vivek Ramanujan

Vivek Ramanujan

Alert button

On the Connection between Pre-training Data Diversity and Fine-tuning Robustness

Jul 24, 2023
Vivek Ramanujan, Thao Nguyen, Sewoong Oh, Ludwig Schmidt, Ali Farhadi

Figure 1 for On the Connection between Pre-training Data Diversity and Fine-tuning Robustness
Figure 2 for On the Connection between Pre-training Data Diversity and Fine-tuning Robustness
Figure 3 for On the Connection between Pre-training Data Diversity and Fine-tuning Robustness
Figure 4 for On the Connection between Pre-training Data Diversity and Fine-tuning Robustness
Viaarxiv icon

Neural Priming for Sample-Efficient Adaptation

Jun 24, 2023
Matthew Wallingford, Vivek Ramanujan, Alex Fang, Aditya Kusupati, Roozbeh Mottaghi, Aniruddha Kembhavi, Ludwig Schmidt, Ali Farhadi

Figure 1 for Neural Priming for Sample-Efficient Adaptation
Figure 2 for Neural Priming for Sample-Efficient Adaptation
Figure 3 for Neural Priming for Sample-Efficient Adaptation
Figure 4 for Neural Priming for Sample-Efficient Adaptation
Viaarxiv icon

DataComp: In search of the next generation of multimodal datasets

May 03, 2023
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt

Figure 1 for DataComp: In search of the next generation of multimodal datasets
Figure 2 for DataComp: In search of the next generation of multimodal datasets
Figure 3 for DataComp: In search of the next generation of multimodal datasets
Figure 4 for DataComp: In search of the next generation of multimodal datasets
Viaarxiv icon

Neural Radiance Field Codebooks

Jan 10, 2023
Matthew Wallingford, Aditya Kusupati, Alex Fang, Vivek Ramanujan, Aniruddha Kembhavi, Roozbeh Mottaghi, Ali Farhadi

Figure 1 for Neural Radiance Field Codebooks
Figure 2 for Neural Radiance Field Codebooks
Figure 3 for Neural Radiance Field Codebooks
Figure 4 for Neural Radiance Field Codebooks
Viaarxiv icon

Matryoshka Representations for Adaptive Deployment

Jun 01, 2022
Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi

Figure 1 for Matryoshka Representations for Adaptive Deployment
Figure 2 for Matryoshka Representations for Adaptive Deployment
Figure 3 for Matryoshka Representations for Adaptive Deployment
Figure 4 for Matryoshka Representations for Adaptive Deployment
Viaarxiv icon

Forward Compatible Training for Representation Learning

Dec 06, 2021
Vivek Ramanujan, Pavan Kumar Anasosalu Vasu, Ali Farhadi, Oncel Tuzel, Hadi Pouransari

Figure 1 for Forward Compatible Training for Representation Learning
Figure 2 for Forward Compatible Training for Representation Learning
Figure 3 for Forward Compatible Training for Representation Learning
Figure 4 for Forward Compatible Training for Representation Learning
Viaarxiv icon

LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes

Jun 02, 2021
Aditya Kusupati, Matthew Wallingford, Vivek Ramanujan, Raghav Somani, Jae Sung Park, Krishna Pillutla, Prateek Jain, Sham Kakade, Ali Farhadi

Figure 1 for LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
Figure 2 for LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
Figure 3 for LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
Figure 4 for LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
Viaarxiv icon

Parameter Norm Growth During Training of Transformers

Nov 11, 2020
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah Smith

Figure 1 for Parameter Norm Growth During Training of Transformers
Figure 2 for Parameter Norm Growth During Training of Transformers
Figure 3 for Parameter Norm Growth During Training of Transformers
Figure 4 for Parameter Norm Growth During Training of Transformers
Viaarxiv icon