Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Zhewei Yao

What's Hidden in a One-layer Randomly Weighted Transformer?


Sep 08, 2021
Sheng Shen, Zhewei Yao, Douwe Kiela, Kurt Keutzer, Michael W. Mahoney

* EMNLP 2021 (short) 

  Access Paper or Ask Questions

How Much Can CLIP Benefit Vision-and-Language Tasks?


Jul 13, 2021
Sheng Shen, Liunian Harold Li, Hao Tan, Mohit Bansal, Anna Rohrbach, Kai-Wei Chang, Zhewei Yao, Kurt Keutzer

* 14 pages 

  Access Paper or Ask Questions

MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models


May 30, 2021
Zhewei Yao, Linjian Ma, Sheng Shen, Kurt Keutzer, Michael W. Mahoney

* 20 pages, 4 figures, 9 tables 

  Access Paper or Ask Questions

ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training


Apr 29, 2021
Jianfei Chen, Lianmin Zheng, Zhewei Yao, Dequan Wang, Ion Stoica, Michael W. Mahoney, Joseph E. Gonzalez


  Access Paper or Ask Questions

Q-ASR: Integer-only Zero-shot Quantization for Efficient Speech Recognition


Mar 31, 2021
Sehoon Kim, Amir Gholami, Zhewei Yao, Anirudda Nrusimha, Bohan Zhai, Tianren Gao, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

A Survey of Quantization Methods for Efficient Neural Network Inference


Mar 25, 2021
Amir Gholami, Sehoon Kim, Zhen Dong, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer

* Book Chapter: Low-Power Computer Vision: Improving the Efficiency of Artificial Intelligence 

  Access Paper or Ask Questions

I-BERT: Integer-only BERT Quantization


Feb 11, 2021
Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

Hessian-Aware Pruning and Optimal Neural Implant


Feb 06, 2021
Shixing Yu, Zhewei Yao, Amir Gholami, Zhen Dong, Michael W Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

HAWQV3: Dyadic Neural Network Quantization


Nov 20, 2020
Zhewei Yao, Zhen Dong, Zhangcheng Zheng, Amir Gholami, Jiali Yu, Eric Tan, Leyuan Wang, Qijing Huang, Yida Wang, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

A Statistical Framework for Low-bitwidth Training of Deep Neural Networks


Oct 27, 2020
Jianfei Chen, Yu Gai, Zhewei Yao, Michael W. Mahoney, Joseph E. Gonzalez

* 24 pages 

  Access Paper or Ask Questions

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding


Oct 12, 2020
Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney, Zhewei Yao


  Access Paper or Ask Questions

Benchmarking Semi-supervised Federated Learning


Aug 26, 2020
Zhengming Zhang, Zhewei Yao, Yaoqing Yang, Yujun Yan, Joseph E. Gonzalez, Michael W. Mahoney


  Access Paper or Ask Questions

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning


Jun 01, 2020
Zhewei Yao, Amir Gholami, Sheng Shen, Kurt Keutzer, Michael W. Mahoney


  Access Paper or Ask Questions

Rethinking Batch Normalization in Transformers


Mar 17, 2020
Sheng Shen, Zhewei Yao, Amir Gholami, Michael Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

PyHessian: Neural Networks Through the Lens of the Hessian


Jan 02, 2020
Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney


  Access Paper or Ask Questions

ZeroQ: A Novel Zero Shot Quantization Framework


Jan 01, 2020
Yaohui Cai, Zhewei Yao, Zhen Dong, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks


Nov 10, 2019
Zhen Dong, Zhewei Yao, Yaohui Cai, Daiyaan Arfeen, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT


Sep 25, 2019
Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

ANODEV2: A Coupled Neural ODE Evolution Framework


Jun 10, 2019
Tianjun Zhang, Zhewei Yao, Amir Gholami, Kurt Keutzer, Joseph Gonzalez, George Biros, Michael Mahoney


  Access Paper or Ask Questions

Residual Networks as Nonlinear Systems: Stability Analysis using Linearization


May 31, 2019
Kai Rothauge, Zhewei Yao, Zixi Hu, Michael W. Mahoney


  Access Paper or Ask Questions

HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precision


Apr 29, 2019
Zhen Dong, Zhewei Yao, Amir Gholami, Michael Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

JumpReLU: A Retrofit Defense Strategy for Adversarial Attacks


Apr 07, 2019
N. Benjamin Erichson, Zhewei Yao, Michael W. Mahoney


  Access Paper or Ask Questions

Inefficiency of K-FAC for Large Batch Size Training


Mar 14, 2019
Linjian Ma, Gabe Montague, Jiayu Ye, Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael W. Mahoney


  Access Paper or Ask Questions

Shallow Learning for Fluid Flow Reconstruction with Limited Sensors and Limited Data


Feb 20, 2019
N. Benjamin Erichson, Lionel Mathelin, Zhewei Yao, Steven L. Brunton, Michael W. Mahoney, J. Nathan Kutz


  Access Paper or Ask Questions

Trust Region Based Adversarial Attack on Neural Networks


Dec 16, 2018
Zhewei Yao, Amir Gholami, Peng Xu, Kurt Keutzer, Michael Mahoney


  Access Paper or Ask Questions

Parameter Re-Initialization through Cyclical Batch Size Schedules


Dec 04, 2018
Norman Mu, Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney

* Presented in Systems for Machine Learning Workshop at NeurIPS'18 conference 

  Access Paper or Ask Questions