Alert button
Picture for Norman A. Rink

Norman A. Rink

Alert button

PartIR: Composing SPMD Partitioning Strategies for Machine Learning

Add code
Bookmark button
Alert button
Jan 23, 2024
Sami Alabed, Bart Chrzaszcz, Juliana Franco, Dominik Grewe, Dougal Maclaurin, James Molloy, Tom Natan, Tamara Norman, Xiaoyue Pan, Adam Paszke, Norman A. Rink, Michael Schaarschmidt, Timur Sitdikov, Agnieszka Swietlik, Dimitrios Vytiniotis, Joel Wee

Figure 1 for PartIR: Composing SPMD Partitioning Strategies for Machine Learning
Figure 2 for PartIR: Composing SPMD Partitioning Strategies for Machine Learning
Figure 3 for PartIR: Composing SPMD Partitioning Strategies for Machine Learning
Figure 4 for PartIR: Composing SPMD Partitioning Strategies for Machine Learning
Viaarxiv icon

Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR

Add code
Bookmark button
Alert button
Oct 07, 2022
Sami Alabed, Dominik Grewe, Juliana Franco, Bart Chrzaszcz, Tom Natan, Tamara Norman, Norman A. Rink, Dimitrios Vytiniotis, Michael Schaarschmidt

Figure 1 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 2 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 3 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 4 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Viaarxiv icon

Memory-efficient array redistribution through portable collective communication

Add code
Bookmark button
Alert button
Dec 02, 2021
Norman A. Rink, Adam Paszke, Dimitrios Vytiniotis, Georg Stefan Schmid

Figure 1 for Memory-efficient array redistribution through portable collective communication
Figure 2 for Memory-efficient array redistribution through portable collective communication
Figure 3 for Memory-efficient array redistribution through portable collective communication
Figure 4 for Memory-efficient array redistribution through portable collective communication
Viaarxiv icon