Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Get Pro 💎 Log In/Sign Up 🚀

Picture for Jiarui Fang

Jiarui Fang

https://www.catalyzex.com

Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Feb 22, 2023
Yuliang Liu, Shenggui Li, Jiarui Fang, Yanjun Shao, Boyuan Yao, Yang You

Figure 1 for Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Figure 2 for Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Figure 3 for Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Figure 4 for Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models

Access Paper or Ask Questions

MAP: Memory-aware Automated Intra-op Parallel Training For Foundation Models

Feb 06, 2023
Yuliang Liu, Shenggui Li, Jiarui Fang, Yanjun Shao, Boyuan Yao, Yang You

Figure 1 for MAP: Memory-aware Automated Intra-op Parallel Training For Foundation Models

Figure 2 for MAP: Memory-aware Automated Intra-op Parallel Training For Foundation Models

Figure 3 for MAP: Memory-aware Automated Intra-op Parallel Training For Foundation Models

Figure 4 for MAP: Memory-aware Automated Intra-op Parallel Training For Foundation Models

Access Paper or Ask Questions

Elixir: Train a Large Language Model on a Small GPU Cluster

Dec 10, 2022
Haichen Huang, Jiarui Fang, Hongxin Liu, Shenggui Li, Yang You

Figure 1 for Elixir: Train a Large Language Model on a Small GPU Cluster

Figure 2 for Elixir: Train a Large Language Model on a Small GPU Cluster

Figure 3 for Elixir: Train a Large Language Model on a Small GPU Cluster

Figure 4 for Elixir: Train a Large Language Model on a Small GPU Cluster

Access Paper or Ask Questions

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Sep 06, 2022
Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

Figure 1 for EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Figure 2 for EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Figure 3 for EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Figure 4 for EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Access Paper or Ask Questions

A Frequency-aware Software Cache for Large Recommendation System Embeddings

Aug 08, 2022
Jiarui Fang, Geng Zhang, Jiatong Han, Shenggui Li, Zhengda Bian, Yongbin Li, Jin Liu, Yang You

Figure 1 for A Frequency-aware Software Cache for Large Recommendation System Embeddings

Figure 2 for A Frequency-aware Software Cache for Large Recommendation System Embeddings

Figure 3 for A Frequency-aware Software Cache for Large Recommendation System Embeddings

Figure 4 for A Frequency-aware Software Cache for Large Recommendation System Embeddings

Access Paper or Ask Questions

PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

Aug 12, 2021
Jiarui Fang, Yang Yu, Shenggui Li, Yang You, Jie Zhou

Figure 1 for PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

Figure 2 for PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

Figure 3 for PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

Figure 4 for PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management

* 11 pages

Access Paper or Ask Questions

TurboTransformers: An Efficient GPU Serving System For Transformer Models

Oct 09, 2020
Jiarui Fang, Yang Yu, Chengduo Zhao, Jie Zhou

Figure 1 for TurboTransformers: An Efficient GPU Serving System For Transformer Models

Figure 2 for TurboTransformers: An Efficient GPU Serving System For Transformer Models

Figure 3 for TurboTransformers: An Efficient GPU Serving System For Transformer Models

Figure 4 for TurboTransformers: An Efficient GPU Serving System For Transformer Models

Access Paper or Ask Questions

swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

Mar 16, 2019
Jiarui Fang, Liandeng Li, Haohuan Fu, Jinlei Jiang, Wenlai Zhao, Conghui He, Xin You, Guangwen Yang

Figure 1 for swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

Figure 2 for swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

Figure 3 for swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

Figure 4 for swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

* 10 pages

Access Paper or Ask Questions

RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

Aug 13, 2018
Jiarui Fang, Haohuan Fu, Guangwen Yang, Cho-Jui Hsieh

Figure 1 for RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

Figure 2 for RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

Figure 3 for RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

Figure 4 for RedSync : Reducing Synchronization Traffic for Distributed Deep Learning

* 20 pages

Access Paper or Ask Questions

Log in or sign up instantly 🚀

🔥 Discover incredible developments in machine intelligence

🤖 Quickly get code for any ML model

🔑 Get help from authors, engineers & researchers

Continue with email

Continue with Google

Continue with Github

Continue with LinkedIn

Continue with Facebook

Continue with Twitter

Seconds away from lift-off 🚀

To ensure authors get your request, sign in to proceed instantly

Continue with email

Continue with Github

Continue with Twitter

Continue with Google

Continue with LinkedIn

Continue with Facebook

© 2023 CatalyzeX

Follow us