Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Tianyun Zhang

Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning


Oct 08, 2020
Bingbing Li, Zhenglun Kong, Tianyun Zhang, Ji Li, Zhengang Li, Hang Liu, Caiwen Ding

* Accepted to Findings of EMNLP 2020 

  Access Paper or Ask Questions

Computation on Sparse Neural Networks: an Inspiration for Future Hardware


Apr 24, 2020
Fei Sun, Minghai Qin, Tianyun Zhang, Liu Liu, Yen-Kuang Chen, Yuan Xie

* 9 pages, 3 figures 

  Access Paper or Ask Questions

A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods


Apr 12, 2020
Tianyun Zhang, Xiaolong Ma, Zheng Zhan, Shanglin Zhou, Minghai Qin, Fei Sun, Yen-Kuang Chen, Caiwen Ding, Makan Fardad, Yanzhi Wang


  Access Paper or Ask Questions

BLK-REW: A Unified Block-based DNN Pruning Framework using Reweighted Regularization Method


Feb 22, 2020
Xiaolong Ma, Zhengang Li, Yifan Gong, Tianyun Zhang, Wei Niu, Zheng Zhan, Pu Zhao, Jian Tang, Xue Lin, Bin Ren, Yanzhi Wang


  Access Paper or Ask Questions

An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices


Feb 22, 2020
Xiaolong Ma, Wei Niu, Tianyun Zhang, Sijia Liu, Sheng Lin, Hongjia Li, Xiang Chen, Jian Tang, Kaisheng Ma, Bin Ren, Yanzhi Wang

* arXiv admin note: text overlap with arXiv:1909.05073 

  Access Paper or Ask Questions

An Ultra-Efficient Memristor-Based DNN Framework with Structured Weight Pruning and Quantization Using ADMM


Aug 29, 2019
Geng Yuan, Xiaolong Ma, Caiwen Ding, Sheng Lin, Tianyun Zhang, Zeinab S. Jalali, Yilong Zhao, Li Jiang, Sucheta Soundarajan, Yanzhi Wang


  Access Paper or Ask Questions

Beyond Adversarial Training: Min-Max Optimization in Adversarial Attack and Defense


Jun 09, 2019
Jingkang Wang, Tianyun Zhang, Sijia Liu, Pin-Yu Chen, Jiacen Xu, Makan Fardad, Bo Li


  Access Paper or Ask Questions

Progressive DNN Compression: A Key to Achieve Ultra-High Weight Pruning and Quantization Rates using ADMM


Mar 30, 2019
Shaokai Ye, Xiaoyu Feng, Tianyun Zhang, Xiaolong Ma, Sheng Lin, Zhengang Li, Kaidi Xu, Wujie Wen, Sijia Liu, Jian Tang, Makan Fardad, Xue Lin, Yongpan Liu, Yanzhi Wang


  Access Paper or Ask Questions

ADMM-NN: An Algorithm-Hardware Co-Design Framework of DNNs Using Alternating Direction Method of Multipliers


Dec 31, 2018
Ao Ren, Tianyun Zhang, Shaokai Ye, Jiayu Li, Wenyao Xu, Xuehai Qian, Xue Lin, Yanzhi Wang


  Access Paper or Ask Questions

A Unified Framework of DNN Weight Pruning and Weight Clustering/Quantization Using ADMM


Nov 05, 2018
Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Jiayu Li, Jiaming Xie, Yun Liang, Sijia Liu, Xue Lin, Yanzhi Wang


  Access Paper or Ask Questions

Progressive Weight Pruning of Deep Neural Networks using ADMM


Nov 04, 2018
Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Jiayu Li, Kaidi Xu, Yunfei Yang, Fuxun Yu, Jian Tang, Makan Fardad, Sijia Liu, Xiang Chen, Xue Lin, Yanzhi Wang


  Access Paper or Ask Questions

ADAM-ADMM: A Unified, Systematic Framework of Structured Weight Pruning for DNNs


Jul 29, 2018
Tianyun Zhang, Kaiqi Zhang, Shaokai Ye, Jiayu Li, Jian Tang, Wujie Wen, Xue Lin, Makan Fardad, Yanzhi Wang


  Access Paper or Ask Questions

A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers


Jul 25, 2018
Tianyun Zhang, Shaokai Ye, Kaiqi Zhang, Jian Tang, Wujie Wen, Makan Fardad, Yanzhi Wang

* ECCV 2018, pp 191-207 

  Access Paper or Ask Questions

Systematic Weight Pruning of DNNs using Alternating Direction Method of Multipliers


Apr 22, 2018
Tianyun Zhang, Shaokai Ye, Yipeng Zhang, Yanzhi Wang, Makan Fardad


  Access Paper or Ask Questions