Picture for Haichen Huang

Haichen Huang

Elixir: Train a Large Language Model on a Small GPU Cluster

Add code
Dec 10, 2022
Figure 1 for Elixir: Train a Large Language Model on a Small GPU Cluster
Figure 2 for Elixir: Train a Large Language Model on a Small GPU Cluster
Figure 3 for Elixir: Train a Large Language Model on a Small GPU Cluster
Figure 4 for Elixir: Train a Large Language Model on a Small GPU Cluster
Viaarxiv icon

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

Add code
Oct 28, 2021
Figure 1 for Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
Figure 2 for Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
Figure 3 for Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
Viaarxiv icon