Alert button
Picture for Michael Rabbat

Michael Rabbat

Alert button

Embracing Diversity: Interpretable Zero-shot classification beyond one vector per class

Add code
Bookmark button
Alert button
Apr 25, 2024
Mazda Moayeri, Michael Rabbat, Mark Ibrahim, Diane Bouchacourt

Viaarxiv icon

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping

Add code
Bookmark button
Alert button
Feb 21, 2024
Lucas Lehnert, Sainbayar Sukhbaatar, Paul Mcvay, Michael Rabbat, Yuandong Tian

Viaarxiv icon

A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale

Add code
Bookmark button
Alert button
Sep 12, 2023
Hao-Jun Michael Shi, Tsung-Hsien Lee, Shintaro Iwasaki, Jose Gallego-Posada, Zhijing Li, Kaushik Rangadurai, Dheevatsa Mudigere, Michael Rabbat

Figure 1 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 2 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 3 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 4 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Viaarxiv icon

DINOv2: Learning Robust Visual Features without Supervision

Add code
Bookmark button
Alert button
Apr 14, 2023
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jegou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski

Figure 1 for DINOv2: Learning Robust Visual Features without Supervision
Figure 2 for DINOv2: Learning Robust Visual Features without Supervision
Figure 3 for DINOv2: Learning Robust Visual Features without Supervision
Figure 4 for DINOv2: Learning Robust Visual Features without Supervision
Viaarxiv icon

Green Federated Learning

Add code
Bookmark button
Alert button
Mar 26, 2023
Ashkan Yousefpour, Shen Guo, Ashish Shenoy, Sayan Ghosh, Pierre Stock, Kiwan Maeng, Schalk-Willem Krüger, Michael Rabbat, Carole-Jean Wu, Ilya Mironov

Figure 1 for Green Federated Learning
Figure 2 for Green Federated Learning
Figure 3 for Green Federated Learning
Figure 4 for Green Federated Learning
Viaarxiv icon

Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

Add code
Bookmark button
Alert button
Jan 19, 2023
Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, Nicolas Ballas

Figure 1 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 2 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 3 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 4 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Viaarxiv icon

Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning

Add code
Bookmark button
Alert button
Oct 14, 2022
John Nguyen, Jianyu Wang, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

The Hidden Uniform Cluster Prior in Self-Supervised Learning

Add code
Bookmark button
Alert button
Oct 13, 2022
Mahmoud Assran, Randall Balestriero, Quentin Duval, Florian Bordes, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Nicolas Ballas

Figure 1 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 2 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 3 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 4 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Viaarxiv icon

Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning

Add code
Bookmark button
Alert button
Jun 30, 2022
John Nguyen, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

Positive Unlabeled Contrastive Learning

Add code
Bookmark button
Alert button
Jun 01, 2022
Anish Acharya, Sujay Sanghavi, Li Jing, Bhargav Bhushanam, Dhruv Choudhary, Michael Rabbat, Inderjit Dhillon

Figure 1 for Positive Unlabeled Contrastive Learning
Figure 2 for Positive Unlabeled Contrastive Learning
Figure 3 for Positive Unlabeled Contrastive Learning
Figure 4 for Positive Unlabeled Contrastive Learning
Viaarxiv icon