Alert button
Picture for Yanzhi Wang

Yanzhi Wang

Alert button

EdgeQAT: Entropy and Distribution Guided Quantization-Aware Training for the Acceleration of Lightweight LLMs on the Edge

Feb 16, 2024
Xuan Shen, Zhenglun Kong, Changdi Yang, Zhaoyang Han, Lei Lu, Peiyan Dong, Cheng Lyu, Chih-hsiang Li, Xuehang Guo, Zhihao Shu, Wei Niu, Miriam Leeser, Pu Zhao, Yanzhi Wang

Viaarxiv icon

SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing

Jan 30, 2024
Sheng Li, Geng Yuan, Yue Dai, Youtao Zhang, Yanzhi Wang, Xulong Tang

Figure 1 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 2 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 3 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Figure 4 for SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
Viaarxiv icon

EdgeOL: Efficient in-situ Online Learning on Edge Devices

Jan 30, 2024
Sheng Li, Geng Yuan, Yawen Wu, Yue Dai, Chao Wu, Alex K. Jones, Jingtong Hu, Yanzhi Wang, Xulong Tang

Viaarxiv icon

E$^{2}$GAN: Efficient Training of Efficient GANs for Image-to-Image Translation

Jan 11, 2024
Yifan Gong, Zheng Zhan, Qing Jin, Yanyu Li, Yerlan Idelbayev, Xian Liu, Andrey Zharkov, Kfir Aberman, Sergey Tulyakov, Yanzhi Wang, Jian Ren

Viaarxiv icon

Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge

Dec 09, 2023
Xuan Shen, Peiyan Dong, Lei Lu, Zhenglun Kong, Zhengang Li, Ming Lin, Chao Wu, Yanzhi Wang

Viaarxiv icon

SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices

Sep 21, 2023
Zhengang Li, Geng Yuan, Tomoharu Yamauchi, Zabihi Masoud, Yanyue Xie, Peiyan Dong, Xulong Tang, Nobuyuki Yoshikawa, Devesh Tiwari, Yanzhi Wang, Olivia Chen

Figure 1 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 2 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 3 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Figure 4 for SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices
Viaarxiv icon

SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds

Jun 03, 2023
Yanyu Li, Huan Wang, Qing Jin, Ju Hu, Pavlo Chemerys, Yun Fu, Yanzhi Wang, Sergey Tulyakov, Jian Ren

Figure 1 for SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds
Figure 2 for SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds
Figure 3 for SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds
Figure 4 for SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds
Viaarxiv icon

DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning

Apr 30, 2023
Zifeng Wang, Zheng Zhan, Yifan Gong, Yucai Shao, Stratis Ioannidis, Yanzhi Wang, Jennifer Dy

Figure 1 for DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning
Figure 2 for DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning
Figure 3 for DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning
Figure 4 for DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning
Viaarxiv icon

Can Adversarial Examples Be Parsed to Reveal Victim Model Information?

Mar 15, 2023
Yuguang Yao, Jiancheng Liu, Yifan Gong, Xiaoming Liu, Yanzhi Wang, Xue Lin, Sijia Liu

Figure 1 for Can Adversarial Examples Be Parsed to Reveal Victim Model Information?
Figure 2 for Can Adversarial Examples Be Parsed to Reveal Victim Model Information?
Figure 3 for Can Adversarial Examples Be Parsed to Reveal Victim Model Information?
Figure 4 for Can Adversarial Examples Be Parsed to Reveal Victim Model Information?
Viaarxiv icon

DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network

Mar 05, 2023
Xuan Shen, Yaohua Wang, Ming Lin, Yilun Huang, Hao Tang, Xiuyu Sun, Yanzhi Wang

Figure 1 for DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network
Figure 2 for DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network
Figure 3 for DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network
Figure 4 for DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network
Viaarxiv icon