Alert button
Picture for Lin Niu

Lin Niu

Alert button

E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity

Oct 24, 2023
Yun Li, Lin Niu, Xipeng Zhang, Kai Liu, Jianchen Zhu, Zhanhui Kang

Viaarxiv icon

Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric

Apr 25, 2023
Lin Niu, Jiawei Liu, Zhihang Yuan, Dawei Yang, Xinggang Wang, Wenyu Liu

Figure 1 for Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric
Figure 2 for Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric
Figure 3 for Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric
Figure 4 for Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric
Viaarxiv icon

RPTQ: Reorder-based Post-training Quantization for Large Language Models

Apr 25, 2023
Zhihang Yuan, Lin Niu, Jiawei Liu, Wenyu Liu, Xinggang Wang, Yuzhang Shang, Guangyu Sun, Qiang Wu, Jiaxiang Wu, Bingzhe Wu

Figure 1 for RPTQ: Reorder-based Post-training Quantization for Large Language Models
Figure 2 for RPTQ: Reorder-based Post-training Quantization for Large Language Models
Figure 3 for RPTQ: Reorder-based Post-training Quantization for Large Language Models
Figure 4 for RPTQ: Reorder-based Post-training Quantization for Large Language Models
Viaarxiv icon

Post-Training Quantization for Object Detection

Apr 19, 2023
Lin Niu, Jiawei Liu, Zhihang Yuan, Dawei Yang, Xinggang Wang, Wenyu Liu

Figure 1 for Post-Training Quantization for Object Detection
Figure 2 for Post-Training Quantization for Object Detection
Figure 3 for Post-Training Quantization for Object Detection
Figure 4 for Post-Training Quantization for Object Detection
Viaarxiv icon

PD-Quant: Post-Training Quantization based on Prediction Difference Metric

Dec 14, 2022
Jiawei Liu, Lin Niu, Zhihang Yuan, Dawei Yang, Xinggang Wang, Wenyu Liu

Figure 1 for PD-Quant: Post-Training Quantization based on Prediction Difference Metric
Figure 2 for PD-Quant: Post-Training Quantization based on Prediction Difference Metric
Figure 3 for PD-Quant: Post-Training Quantization based on Prediction Difference Metric
Figure 4 for PD-Quant: Post-Training Quantization based on Prediction Difference Metric
Viaarxiv icon