Alert button

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Jan 27, 2023
Max Ryabinin, Tim Dettmers, Michael Diskin, Alexander Borzunov

Figure 1 for SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
Figure 2 for SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
Figure 3 for SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
Figure 4 for SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Share this with someone who'll enjoy it:

View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: