Picture for Xiaonan Song

Xiaonan Song

MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design

Add code
Dec 19, 2024
Figure 1 for MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Figure 2 for MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Figure 3 for MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Figure 4 for MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Viaarxiv icon