Alert button
Picture for Sam Ade Jacobs

Sam Ade Jacobs

Alert button

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models

Sep 25, 2023
Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, Minjia Zhang, Leon Song, Samyam Rajbhandari, Yuxiong He

Viaarxiv icon

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training

Jun 16, 2023
Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

Figure 1 for ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Figure 2 for ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Figure 3 for ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Figure 4 for ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Viaarxiv icon

Learning Interpretable Models Through Multi-Objective Neural Architecture Search

Dec 16, 2021
Zachariah Carmichael, Tim Moon, Sam Ade Jacobs

Figure 1 for Learning Interpretable Models Through Multi-Objective Neural Architecture Search
Figure 2 for Learning Interpretable Models Through Multi-Objective Neural Architecture Search
Figure 3 for Learning Interpretable Models Through Multi-Objective Neural Architecture Search
Figure 4 for Learning Interpretable Models Through Multi-Objective Neural Architecture Search
Viaarxiv icon

Merlin: Enabling Machine Learning-Ready HPC Ensembles

Dec 05, 2019
J. Luc Peterson, Rushil Anirudh, Kevin Athey, Benjamin Bay, Peer-Timo Bremer, Vic Castillo, Francesco Di Natale, David Fox, Jim A. Gaffney, David Hysom, Sam Ade Jacobs, Bhavya Kailkhura, Joe Koning, Bogdan Kustowski, Steven Langer, Peter Robinson, Jessica Semler, Brian Spears, Jayaraman Thiagarajan, Brian Van Essen, Jae-Seung Yeom

Figure 1 for Merlin: Enabling Machine Learning-Ready HPC Ensembles
Figure 2 for Merlin: Enabling Machine Learning-Ready HPC Ensembles
Figure 3 for Merlin: Enabling Machine Learning-Ready HPC Ensembles
Figure 4 for Merlin: Enabling Machine Learning-Ready HPC Ensembles
Viaarxiv icon

Parallelizing Training of Deep Generative Models on Massive Scientific Datasets

Oct 05, 2019
Sam Ade Jacobs, Brian Van Essen, David Hysom, Jae-Seung Yeom, Tim Moon, Rushil Anirudh, Jayaraman J. Thiagaranjan, Shusen Liu, Peer-Timo Bremer, Jim Gaffney, Tom Benson, Peter Robinson, Luc Peterson, Brian Spears

Figure 1 for Parallelizing Training of Deep Generative Models on Massive Scientific Datasets
Figure 2 for Parallelizing Training of Deep Generative Models on Massive Scientific Datasets
Figure 3 for Parallelizing Training of Deep Generative Models on Massive Scientific Datasets
Figure 4 for Parallelizing Training of Deep Generative Models on Massive Scientific Datasets
Viaarxiv icon

Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications

Jul 19, 2019
Shusen Liu, Di Wang, Dan Maljovec, Rushil Anirudh, Jayaraman J. Thiagarajan, Sam Ade Jacobs, Brian C. Van Essen, David Hysom, Jae-Seung Yeom, Jim Gaffney, Luc Peterson, Peter B. Robinson, Harsh Bhatia, Valerio Pascucci, Brian K. Spears, Peer-Timo Bremer

Figure 1 for Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications
Figure 2 for Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications
Figure 3 for Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications
Figure 4 for Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications
Viaarxiv icon

Distinguishing between Normal and Cancer Cells Using Autoencoder Node Saliency

Jan 30, 2019
Ya Ju Fan, Jonathan E. Allen, Sam Ade Jacobs, Brian C. Van Essen

Figure 1 for Distinguishing between Normal and Cancer Cells Using Autoencoder Node Saliency
Figure 2 for Distinguishing between Normal and Cancer Cells Using Autoencoder Node Saliency
Figure 3 for Distinguishing between Normal and Cancer Cells Using Autoencoder Node Saliency
Figure 4 for Distinguishing between Normal and Cancer Cells Using Autoencoder Node Saliency
Viaarxiv icon