Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Yanzhi Wang

Yanzhi Wang

Teachers Do More Than Teach: Compressing Image-to-Image Models


Mar 05, 2021
Qing Jin, Jian Ren, Oliver J. Woodford, Jiazhuo Wang, Geng Yuan, Yanzhi Wang, Sergey Tulyakov

Figure 1 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 2 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 3 for Teachers Do More Than Teach: Compressing Image-to-Image Models
Figure 4 for Teachers Do More Than Teach: Compressing Image-to-Image Models
* 18 pages, 10 figures, accepted by CVPR 2021 
  Access Paper or Ask Questions

Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?


Feb 19, 2021
Ning Liu, Geng Yuan, Zhengping Che, Xuan Shen, Xiaolong Ma, Qing Jin, Jian Ren, Jian Tang, Sijia Liu, Yanzhi Wang

Figure 1 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 2 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 3 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?
Figure 4 for Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?

  Access Paper or Ask Questions

Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device


Dec 26, 2020
Pu Zhao, Wei Niu, Geng Yuan, Yuxuan Cai, Hsin-Hsuan Sung, Wujie Wen, Sijia Liu, Xipeng Shen, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 2 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 3 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device
Figure 4 for Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device

  Access Paper or Ask Questions

Learn-Prune-Share for Lifelong Learning


Dec 13, 2020
Zifeng Wang, Tong Jian, Kaushik Chowdhury, Yanzhi Wang, Jennifer Dy, Stratis Ioannidis

Figure 1 for Learn-Prune-Share for Lifelong Learning
Figure 2 for Learn-Prune-Share for Lifelong Learning
Figure 3 for Learn-Prune-Share for Lifelong Learning
Figure 4 for Learn-Prune-Share for Lifelong Learning
* Accepted to the IEEE International Conference on Data Mining 2020 (ICDM'20) 
  Access Paper or Ask Questions

Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework


Dec 12, 2020
Sung-En Chang, Yanyu Li, Mengshu Sun, Runbin Shi, Hayden K. -H. So, Xuehai Qian, Yanzhi Wang, Xue Lin

Figure 1 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 2 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 3 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Figure 4 for Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
* Accepted by High-Performance Computer Architecture (HPCA'2021) 
  Access Paper or Ask Questions

6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration


Dec 01, 2020
Zhengang Li, Geng Yuan, Wei Niu, Yanyu Li, Pu Zhao, Yuxuan Cai, Xuan Shen, Zheng Zhan, Zhenglun Kong, Qing Jin, Zhiyu Chen, Sijia Liu, Kaiyuan Yang, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 2 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 3 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration
Figure 4 for 6.7ms on Mobile with over 78% ImageNet Accuracy: Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration

  Access Paper or Ask Questions

An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning


Nov 20, 2020
Chengming Zhang, Geng Yuan, Wei Niu, Jiannan Tian, Sian Jin, Donglin Zhuang, Zhe Jiang, Yanzhi Wang, Bin Ren, Shuaiwen Leon Song, Dingwen Tao

Figure 1 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 2 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 3 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
Figure 4 for An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning
* 11 pages, 13 figures, 2 tables 
  Access Paper or Ask Questions

DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search


Nov 04, 2020
Yushuo Guan, Ning Liu, Pengyu Zhao, Zhengping Che, Kaigui Bian, Yanzhi Wang, Jian Tang

Figure 1 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 2 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 3 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Figure 4 for DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search

  Access Paper or Ask Questions

Simultaneous Relevance and Diversity: A New Recommendation Inference Approach


Sep 27, 2020
Yifang Liu, Zhentao Xu, Qiyuan An, Yang Yi, Yanzhi Wang, Trevor Hastie

Figure 1 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 2 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 3 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
Figure 4 for Simultaneous Relevance and Diversity: A New Recommendation Inference Approach
* 9 pages 
  Access Paper or Ask Questions

MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework


Sep 16, 2020
Sung-En Chang, Yanyu Li, Mengshu Sun, Weiwen Jiang, Runbin Shi, Xue Lin, Yanzhi Wang

Figure 1 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 2 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 3 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
Figure 4 for MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework
* 9 pages, 2 figures 
  Access Paper or Ask Questions

Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization


Sep 15, 2020
Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang

Figure 1 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 2 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 3 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization
Figure 4 for Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization

  Access Paper or Ask Questions

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design


Sep 12, 2020
Yuxuan Cai, Hongjia Li, Geng Yuan, Wei Niu, Yanyu Li, Xulong Tang, Bin Ren, Yanzhi Wang

Figure 1 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 2 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 3 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Figure 4 for YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

  Access Paper or Ask Questions

ESMFL: Efficient and Secure Models for Federated Learning


Sep 03, 2020
Sheng Lin, Chenghong Wang, Hongjia Li, Jieren Deng, Yanzhi Wang, Caiwen Ding

Figure 1 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 2 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 3 for ESMFL: Efficient and Secure Models for Federated Learning
Figure 4 for ESMFL: Efficient and Secure Models for Federated Learning
* 7 pages, 3 figures 
  Access Paper or Ask Questions

AntiDote: Attention-based Dynamic Optimization for Neural Network Runtime Efficiency


Aug 14, 2020
Fuxun Yu, Chenchen Liu, Di Wang, Yanzhi Wang, Xiang Chen

* Accepted in DATE'2020 (Best Paper Nomination) 
  Access Paper or Ask Questions

One for Many: Transfer Learning for Building HVAC Control


Aug 09, 2020
Shichao Xu, Yixuan Wang, Yanzhi Wang, Zheng O'Neill, Qi Zhu

Figure 1 for One for Many: Transfer Learning for Building HVAC Control
Figure 2 for One for Many: Transfer Learning for Building HVAC Control
Figure 3 for One for Many: Transfer Learning for Building HVAC Control
Figure 4 for One for Many: Transfer Learning for Building HVAC Control
* Submitted to Buildsys 2020 
  Access Paper or Ask Questions

Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices


Jul 20, 2020
Wei Niu, Mengshu Sun, Zhengang Li, Jou-An Chen, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Xue Lin, Bin Ren

Figure 1 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 2 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 3 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices
Figure 4 for Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

  Access Paper or Ask Questions

Towards Real-Time DNN Inference on Mobile Platforms with Model Pruning and Compiler Optimization


Apr 22, 2020
Wei Niu, Pu Zhao, Zheng Zhan, Xue Lin, Yanzhi Wang, Bin Ren

Figure 1 for Towards Real-Time DNN Inference on Mobile Platforms with Model Pruning and Compiler Optimization
Figure 2 for Towards Real-Time DNN Inference on Mobile Platforms with Model Pruning and Compiler Optimization
* accepted by the IJCAI-PRICAI 2020 Demonstrations Track 
  Access Paper or Ask Questions

A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods


Apr 12, 2020
Tianyun Zhang, Xiaolong Ma, Zheng Zhan, Shanglin Zhou, Minghai Qin, Fei Sun, Yen-Kuang Chen, Caiwen Ding, Makan Fardad, Yanzhi Wang

Figure 1 for A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods
Figure 2 for A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods
Figure 3 for A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods
Figure 4 for A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods

  Access Paper or Ask Questions

CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way


Mar 25, 2020
Shaoshan Liu, Bin Ren, Xipeng Shen, Yanzhi Wang

Figure 1 for CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 2 for CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 3 for CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 4 for CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way

  Access Paper or Ask Questions

CocoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way


Mar 14, 2020
Shaoshan Liu, Bin Ren, Xipeng Shen, Yanzhi Wang

Figure 1 for CocoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 2 for CocoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 3 for CocoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way
Figure 4 for CocoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way

  Access Paper or Ask Questions

A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework


Mar 13, 2020
Zheng Zhan, Yifan Gong, Zhengang Li, Pu Zhao, Xiaolong Ma, Wei Niu, Xiaolin Xu, Bin Ren, Yanzhi Wang, Xue Lin

Figure 1 for A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework
Figure 2 for A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework
Figure 3 for A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework
Figure 4 for A Privacy-Preserving DNN Pruning and Mobile Acceleration Framework

  Access Paper or Ask Questions

BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method


Feb 22, 2020
Xiaolong Ma, Zhengang Li, Yifan Gong, Tianyun Zhang, Wei Niu, Zheng Zhan, Pu Zhao, Jian Tang, Xue Lin, Bin Ren, Yanzhi Wang

Figure 1 for BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method
Figure 2 for BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method
Figure 3 for BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method
Figure 4 for BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method

  Access Paper or Ask Questions

An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices


Feb 22, 2020
Xiaolong Ma, Wei Niu, Tianyun Zhang, Sijia Liu, Sheng Lin, Hongjia Li, Xiang Chen, Jian Tang, Kaisheng Ma, Bin Ren, Yanzhi Wang

Figure 1 for An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices
Figure 2 for An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices
Figure 3 for An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices
Figure 4 for An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices
* arXiv admin note: text overlap with arXiv:1909.05073 
  Access Paper or Ask Questions

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition


Feb 19, 2020
Peiyan Dong, Siyue Wang, Wei Niu, Chengming Zhang, Sheng Lin, Zhengang Li, Yifan Gong, Bin Ren, Xue Lin, Yanzhi Wang, Dingwen Tao

Figure 1 for RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Figure 2 for RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Figure 3 for RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Figure 4 for RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

  Access Paper or Ask Questions

Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space


Feb 12, 2020
Mohammad Saeed Abrishami, Amir Erfan Eshratifar, David Eigen, Yanzhi Wang, Shahin Nazarian, Massoud Pedram

Figure 1 for Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space
Figure 2 for Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space
Figure 3 for Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space
Figure 4 for Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space

  Access Paper or Ask Questions

PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators


Feb 11, 2020
Zhanhong Tan, Jiebo Song, Xiaolong Ma, Sia-Huat Tan, Hongyang Chen, Yuanqing Miao, Yifu Wu, Shaokai Ye, Yanzhi Wang, Dehui Li, Kaisheng Ma

Figure 1 for PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
Figure 2 for PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
Figure 3 for PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
Figure 4 for PCNN: Pattern-based Fine-Grained Regular Pruning towards Optimizing CNN Accelerators
* 6 pages, DAC 2020 accepted paper 
  Access Paper or Ask Questions

SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency


Jan 23, 2020
Zhengang Li, Yifan Gong, Xiaolong Ma, Sijia Liu, Mengshu Sun, Zheng Zhan, Zhenglun Kong, Geng Yuan, Yanzhi Wang

Figure 1 for SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency
Figure 2 for SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency
Figure 3 for SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency
Figure 4 for SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency

  Access Paper or Ask Questions

Embedding Compression with Isotropic Iterative Quantization


Jan 23, 2020
Siyu Liao, Jie Chen, Yanzhi Wang, Qinru Qiu, Bo Yuan

Figure 1 for Embedding Compression with Isotropic Iterative Quantization
Figure 2 for Embedding Compression with Isotropic Iterative Quantization
Figure 3 for Embedding Compression with Isotropic Iterative Quantization
Figure 4 for Embedding Compression with Isotropic Iterative Quantization

  Access Paper or Ask Questions

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning


Jan 22, 2020
Wei Niu, Xiaolong Ma, Sheng Lin, Shihao Wang, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

Figure 1 for PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
Figure 2 for PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
Figure 3 for PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
Figure 4 for PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
* To be published in the Proceedings of Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 20) 
  Access Paper or Ask Questions