Picture for Fengcun Li

Fengcun Li

EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference

Add code
Oct 16, 2024
Figure 1 for EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
Figure 2 for EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
Figure 3 for EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
Figure 4 for EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
Viaarxiv icon