Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Yanzhi Wang

Yanzhi Wang

Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks


Sep 08, 2021
Cheng Gong, Ye Lu, Kunpeng Xie, Zongming Jin, Tao Li, Yanzhi Wang

Figure 1 for Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks
Figure 2 for Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks
Figure 3 for Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks
Figure 4 for Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks
* 15 pages, 14 figures 
  Access Paper or Ask Questions

DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion


Aug 30, 2021
Wei Niu, Jiexiong Guan, Yanzhi Wang, Gagan Agrawal, Bin Ren

Figure 1 for DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion
Figure 2 for DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion
Figure 3 for DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion
Figure 4 for DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion

  Access Paper or Ask Questions

GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity


Aug 25, 2021
Wei Niu, Zhengang Li, Xiaolong Ma, Peiyan Dong, Gang Zhou, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

Figure 1 for GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity
Figure 2 for GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity
Figure 3 for GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity
Figure 4 for GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity
* Accepted in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 
  Access Paper or Ask Questions

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search


Aug 18, 2021
Zheng Zhan, Yifan Gong, Pu Zhao, Geng Yuan, Wei Niu, Yushu Wu, Tianyun Zhang, Malith Jayaweera, David Kaeli, Bin Ren, Xue Lin, Yanzhi Wang

Figure 1 for Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search
Figure 2 for Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search
Figure 3 for Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search
Figure 4 for Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search

  Access Paper or Ask Questions

CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference


Jul 06, 2021
Zhiyu Chen, Zhanghao Yu, Qing Jin, Yan He, Jingyu Wang, Sheng Lin, Dai Li, Yanzhi Wang, Kaiyuan Yang

Figure 1 for CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference
Figure 2 for CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference
Figure 3 for CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference
Figure 4 for CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference
* IEEE Journal of Solid-State Circuits, Volume: 56, Issue: 6, Pages: 1924 - 1935, June 2021 
 * This work has been accepted by IEEE Journal of Solid-State Circuits (JSSC 2021) 
  Access Paper or Ask Questions

Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?


Jul 01, 2021
Xiaolong Ma, Geng Yuan, Xuan Shen, Tianlong Chen, Xuxi Chen, Xiaohan Chen, Ning Liu, Minghai Qin, Sijia Liu, Zhangyang Wang, Yanzhi Wang

Figure 1 for Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?
Figure 2 for Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?
Figure 3 for Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?
Figure 4 for Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?

  Access Paper or Ask Questions

Achieving Real-Time Object Detection on MobileDevices with Neural Pruning Search


Jun 28, 2021
Pu Zhao, Wei Niu, Geng Yuan, Yuxuan Cai, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for Achieving Real-Time Object Detection on MobileDevices with Neural Pruning Search
Figure 2 for Achieving Real-Time Object Detection on MobileDevices with Neural Pruning Search
* Presented on the HiPEAC 2021 workshop (cogarch 2021) 
  Access Paper or Ask Questions

Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI


Jun 18, 2021
Geng Yuan, Zhiheng Liao, Xiaolong Ma, Yuxuan Cai, Zhenglun Kong, Xuan Shen, Jingyan Fu, Zhengang Li, Chengming Zhang, Hongwu Peng, Ning Liu, Ao Ren, Jinhui Wang, Yanzhi Wang

Figure 1 for Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI
Figure 2 for Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI
Figure 3 for Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI
Figure 4 for Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI
* In Proceedings of the 22nd International Symposium on Quality Electronic Design (ISQED), 2021 
  Access Paper or Ask Questions

Effective Model Sparsification by Scheduled Grow-and-Prune Methods


Jun 18, 2021
Xiaolong Ma, Minghai Qin, Fei Sun, Zejiang Hou, Kun Yuan, Yi Xu, Yanzhi Wang, Yen-Kuang Chen, Rong Jin, Yuan Xie

Figure 1 for Effective Model Sparsification by Scheduled Grow-and-Prune Methods
Figure 2 for Effective Model Sparsification by Scheduled Grow-and-Prune Methods
Figure 3 for Effective Model Sparsification by Scheduled Grow-and-Prune Methods
Figure 4 for Effective Model Sparsification by Scheduled Grow-and-Prune Methods

  Access Paper or Ask Questions

FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator


Jun 16, 2021
Geng Yuan, Payman Behnam, Zhengang Li, Ali Shafiee, Sheng Lin, Xiaolong Ma, Hang Liu, Xuehai Qian, Mahdi Nazm Bojnordi, Yanzhi Wang, Caiwen Ding

Figure 1 for FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator
Figure 2 for FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator
Figure 3 for FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator
Figure 4 for FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator
* In Proceedings of the 48th Annual International Symposium on Computer Architecture (ISCA), 2021 
  Access Paper or Ask Questions

Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression


Jun 16, 2021
Sheng Lin, Wei Jiang, Wei Wang, Kaidi Xu, Yanzhi Wang, Shan Liu, Songnan Li

Figure 1 for Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression
Figure 2 for Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression
Figure 3 for Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression
Figure 4 for Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression
* 10 pages, 3 figures and 5 tables 
  Access Paper or Ask Questions

Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices


Jun 06, 2021
Xuan Shen, Geng Yuan, Wei Niu, Xiaolong Ma, Jiexiong Guan, Zhengang Li, Bin Ren, Yanzhi Wang

Figure 1 for Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices
Figure 2 for Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices
Figure 3 for Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices
Figure 4 for Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices

  Access Paper or Ask Questions

A Compression-Compilation Framework for On-mobile Real-time BERT Applications


Jun 06, 2021
Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang

Figure 1 for A Compression-Compilation Framework for On-mobile Real-time BERT Applications
Figure 2 for A Compression-Compilation Framework for On-mobile Real-time BERT Applications
Figure 3 for A Compression-Compilation Framework for On-mobile Real-time BERT Applications
Figure 4 for A Compression-Compilation Framework for On-mobile Real-time BERT Applications
* arXiv admin note: substantial text overlap with arXiv:2009.06823 
  Access Paper or Ask Questions

Teachers Do More Than Teach: Compressing Image-to-Image Models


Mar 05, 2021
Qing Jin, Jian Ren, Oliver J. Woodford, Jiazhuo Wang, Geng Yuan, Yanzhi Wang, Sergey Tulyakov

Figure 1 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 2 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 3 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 4 for Teachers Do More Than Teach: Compressing Image-to-Image Models
* 18 pages, 10 figures, accepted by CVPR 2021 
  Access Paper or Ask Questions

Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?


Feb 19, 2021
Ning Liu, Geng Yuan, Zhengping Che, Xuan Shen, Xiaolong Ma, Qing Jin, Jian Ren, Jian Tang, Sijia Liu, Yanzhi Wang

Figure 1 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 2 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 3 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 4 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?

  Access Paper or Ask Questions

Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device


Dec 26, 2020
Pu Zhao, Wei Niu, Geng Yuan, Yuxuan Cai, Hsin-Hsuan Sung, Wujie Wen, Sijia Liu, Xipeng Shen, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 2 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 3 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 4 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device

  Access Paper or Ask Questions

Learn-Prune-Share for Lifelong Learning


Dec 13, 2020
Zifeng Wang, Tong Jian, Kaushik Chowdhury, Yanzhi Wang, Jennifer Dy, Stratis Ioannidis

Figure 1 for Learn-Prune-Share for Lifelong Learning
Figure 2 for Learn-Prune-Share for Lifelong Learning
Figure 3 for Learn-Prune-Share for Lifelong Learning
Figure 4 for Learn-Prune-Share for Lifelong Learning
* Accepted to the IEEE International Conference on Data Mining 2020 (ICDM'20) 
  Access Paper or Ask Questions

Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework


Dec 12, 2020
Sung-En Chang, Yanyu Li, Mengshu Sun, Runbin Shi, Hayden K. -H. So, Xuehai Qian, Yanzhi Wang, Xue Lin

Figure 1 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 2 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 3 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 4 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
* Accepted by High-Performance Computer Architecture (HPCA'2021) 
  Access Paper or Ask Questions

6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration


Dec 01, 2020
Zhengang Li, Geng Yuan, Wei Niu, Yanyu Li, Pu Zhao, Yuxuan Cai, Xuan Shen, Zheng Zhan, Zhenglun Kong, Qing Jin, Zhiyu Chen, Sijia Liu, Kaiyuan Yang, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 2 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 3 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 4 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration

  Access Paper or Ask Questions

An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning


Nov 20, 2020
Chengming Zhang, Geng Yuan, Wei Niu, Jiannan Tian, Sian Jin, Donglin Zhuang, Zhe Jiang, Yanzhi Wang, Bin Ren, Shuaiwen Leon Song, Dingwen Tao

Figure 1 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 2 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 3 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 4 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
* 11 pages, 13 figures, 2 tables 
  Access Paper or Ask Questions

DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search


Nov 04, 2020
Yushuo Guan, Ning Liu, Pengyu Zhao, Zhengping Che, Kaigui Bian, Yanzhi Wang, Jian Tang

Figure 1 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 2 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 3 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 4 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search

  Access Paper or Ask Questions

Simultaneous Relevance and Diversity: A New Recommendation Inference Approach


Sep 27, 2020
Yifang Liu, Zhentao Xu, Qiyuan An, Yang Yi, Yanzhi Wang, Trevor Hastie

Figure 1 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 2 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 3 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 4 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
* 9 pages 
  Access Paper or Ask Questions

MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework


Sep 16, 2020
Sung-En Chang, Yanyu Li, Mengshu Sun, Weiwen Jiang, Runbin Shi, Xue Lin, Yanzhi Wang

Figure 1 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 2 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 3 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 4 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
* 9 pages, 2 figures 
  Access Paper or Ask Questions

Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization


Sep 15, 2020
Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang

Figure 1 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 2 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 3 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 4 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization

  Access Paper or Ask Questions

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design


Sep 12, 2020
Yuxuan Cai, Hongjia Li, Geng Yuan, Wei Niu, Yanyu Li, Xulong Tang, Bin Ren, Yanzhi Wang

Figure 1 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 2 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 3 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 4 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

  Access Paper or Ask Questions

ESMFL: Efficient and Secure Models for Federated Learning


Sep 03, 2020
Sheng Lin, Chenghong Wang, Hongjia Li, Jieren Deng, Yanzhi Wang, Caiwen Ding

Figure 1 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 2 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 3 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 4 for ESMFL: Efficient and Secure Models for Federated Learning
* 7 pages, 3 figures 
  Access Paper or Ask Questions

AntiDote: Attention-based Dynamic Optimization for Neural Network Runtime Efficiency


Aug 14, 2020
Fuxun Yu, Chenchen Liu, Di Wang, Yanzhi Wang, Xiang Chen

* Accepted in DATE'2020 (Best Paper Nomination) 
  Access Paper or Ask Questions

One for Many: Transfer Learning for Building HVAC Control


Aug 09, 2020
Shichao Xu, Yixuan Wang, Yanzhi Wang, Zheng O'Neill, Qi Zhu

Figure 1 for One for Many: Transfer Learning for Building HVAC Control
Figure 2 for One for Many: Transfer Learning for Building HVAC Control
Figure 3 for One for Many: Transfer Learning for Building HVAC Control
Figure 4 for One for Many: Transfer Learning for Building HVAC Control
* Submitted to Buildsys 2020 
  Access Paper or Ask Questions

Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices


Jul 20, 2020
Wei Niu, Mengshu Sun, Zhengang Li, Jou-An Chen, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Xue Lin, Bin Ren

Figure 1 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 2 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 3 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 4 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

  Access Paper or Ask Questions