Alert button
Picture for Norman A. Rink

Norman A. Rink

Alert button

PartIR: Composing SPMD Partitioning Strategies for Machine Learning

Jan 23, 2024
Sami Alabed, Bart Chrzaszcz, Juliana Franco, Dominik Grewe, Dougal Maclaurin, James Molloy, Tom Natan, Tamara Norman, Xiaoyue Pan, Adam Paszke, Norman A. Rink, Michael Schaarschmidt, Timur Sitdikov, Agnieszka Swietlik, Dimitrios Vytiniotis, Joel Wee

Viaarxiv icon

Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR

Oct 07, 2022
Sami Alabed, Dominik Grewe, Juliana Franco, Bart Chrzaszcz, Tom Natan, Tamara Norman, Norman A. Rink, Dimitrios Vytiniotis, Michael Schaarschmidt

Figure 1 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 2 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 3 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Figure 4 for Automatic Discovery of Composite SPMD Partitioning Strategies in PartIR
Viaarxiv icon

Memory-efficient array redistribution through portable collective communication

Dec 02, 2021
Norman A. Rink, Adam Paszke, Dimitrios Vytiniotis, Georg Stefan Schmid

Figure 1 for Memory-efficient array redistribution through portable collective communication
Figure 2 for Memory-efficient array redistribution through portable collective communication
Figure 3 for Memory-efficient array redistribution through portable collective communication
Figure 4 for Memory-efficient array redistribution through portable collective communication
Viaarxiv icon