Alert button
Picture for Michael Rabbat

Michael Rabbat

Alert button

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping

Feb 21, 2024
Lucas Lehnert, Sainbayar Sukhbaatar, Paul Mcvay, Michael Rabbat, Yuandong Tian

Viaarxiv icon

A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale

Sep 12, 2023
Hao-Jun Michael Shi, Tsung-Hsien Lee, Shintaro Iwasaki, Jose Gallego-Posada, Zhijing Li, Kaushik Rangadurai, Dheevatsa Mudigere, Michael Rabbat

Figure 1 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 2 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 3 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Figure 4 for A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
Viaarxiv icon

DINOv2: Learning Robust Visual Features without Supervision

Apr 14, 2023
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jegou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski

Figure 1 for DINOv2: Learning Robust Visual Features without Supervision
Figure 2 for DINOv2: Learning Robust Visual Features without Supervision
Figure 3 for DINOv2: Learning Robust Visual Features without Supervision
Figure 4 for DINOv2: Learning Robust Visual Features without Supervision
Viaarxiv icon

Green Federated Learning

Mar 26, 2023
Ashkan Yousefpour, Shen Guo, Ashish Shenoy, Sayan Ghosh, Pierre Stock, Kiwan Maeng, Schalk-Willem Krüger, Michael Rabbat, Carole-Jean Wu, Ilya Mironov

Figure 1 for Green Federated Learning
Figure 2 for Green Federated Learning
Figure 3 for Green Federated Learning
Figure 4 for Green Federated Learning
Viaarxiv icon

Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

Jan 19, 2023
Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, Nicolas Ballas

Figure 1 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 2 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 3 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Figure 4 for Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Viaarxiv icon

Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning

Oct 14, 2022
John Nguyen, Jianyu Wang, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

The Hidden Uniform Cluster Prior in Self-Supervised Learning

Oct 13, 2022
Mahmoud Assran, Randall Balestriero, Quentin Duval, Florian Bordes, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Nicolas Ballas

Figure 1 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 2 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 3 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Figure 4 for The Hidden Uniform Cluster Prior in Self-Supervised Learning
Viaarxiv icon

Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning

Jun 30, 2022
John Nguyen, Kshitiz Malik, Maziar Sanjabi, Michael Rabbat

Figure 1 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 2 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 3 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Figure 4 for Where to Begin? Exploring the Impact of Pre-Training and Initialization in Federated Learning
Viaarxiv icon

Positive Unlabeled Contrastive Learning

Jun 01, 2022
Anish Acharya, Sujay Sanghavi, Li Jing, Bhargav Bhushanam, Dhruv Choudhary, Michael Rabbat, Inderjit Dhillon

Figure 1 for Positive Unlabeled Contrastive Learning
Figure 2 for Positive Unlabeled Contrastive Learning
Figure 3 for Positive Unlabeled Contrastive Learning
Figure 4 for Positive Unlabeled Contrastive Learning
Viaarxiv icon

FedShuffle: Recipes for Better Use of Local Work in Federated Learning

Apr 27, 2022
Samuel Horváth, Maziar Sanjabi, Lin Xiao, Peter Richtárik, Michael Rabbat

Figure 1 for FedShuffle: Recipes for Better Use of Local Work in Federated Learning
Figure 2 for FedShuffle: Recipes for Better Use of Local Work in Federated Learning
Figure 3 for FedShuffle: Recipes for Better Use of Local Work in Federated Learning
Figure 4 for FedShuffle: Recipes for Better Use of Local Work in Federated Learning
Viaarxiv icon