Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed
HAWQV3: Dyadic Neural Network Quantization

Nov 20, 2020
Zhewei Yao, Zhen Dong, Zhangcheng Zheng, Amir Gholami, Jiali Yu, Eric Tan, Leyuan Wang, Qijing Huang, Yida Wang, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

A Statistical Framework for Low-bitwidth Training of Deep Neural Networks

Oct 27, 2020
Jianfei Chen, Yu Gai, Zhewei Yao, Michael W. Mahoney, Joseph E. Gonzalez

* 24 pages 

  Access Paper or Ask Questions

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding

Oct 12, 2020
Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney, Zhewei Yao


  Access Paper or Ask Questions

Benchmarking Semi-supervised Federated Learning

Aug 26, 2020
Zhengming Zhang, Zhewei Yao, Yaoqing Yang, Yujun Yan, Joseph E. Gonzalez, Michael W. Mahoney


  Access Paper or Ask Questions

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Jun 01, 2020
Zhewei Yao, Amir Gholami, Sheng Shen, Kurt Keutzer, Michael W. Mahoney


  Access Paper or Ask Questions

Rethinking Batch Normalization in Transformers

Mar 17, 2020
Sheng Shen, Zhewei Yao, Amir Gholami, Michael Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

PyHessian: Neural Networks Through the Lens of the Hessian

Jan 02, 2020
Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney


  Access Paper or Ask Questions

ZeroQ: A Novel Zero Shot Quantization Framework

Jan 01, 2020
Yaohui Cai, Zhewei Yao, Zhen Dong, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks

Nov 10, 2019
Zhen Dong, Zhewei Yao, Yaohui Cai, Daiyaan Arfeen, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

Sep 25, 2019
Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, Zhewei Yao, Amir Gholami, Michael W. Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

ANODEV2: A Coupled Neural ODE Evolution Framework

Jun 10, 2019
Tianjun Zhang, Zhewei Yao, Amir Gholami, Kurt Keutzer, Joseph Gonzalez, George Biros, Michael Mahoney


  Access Paper or Ask Questions

Residual Networks as Nonlinear Systems: Stability Analysis using Linearization

May 31, 2019
Kai Rothauge, Zhewei Yao, Zixi Hu, Michael W. Mahoney


  Access Paper or Ask Questions

HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precision

Apr 29, 2019
Zhen Dong, Zhewei Yao, Amir Gholami, Michael Mahoney, Kurt Keutzer


  Access Paper or Ask Questions

JumpReLU: A Retrofit Defense Strategy for Adversarial Attacks

Apr 07, 2019
N. Benjamin Erichson, Zhewei Yao, Michael W. Mahoney


  Access Paper or Ask Questions

Inefficiency of K-FAC for Large Batch Size Training

Mar 14, 2019
Linjian Ma, Gabe Montague, Jiayu Ye, Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael W. Mahoney


  Access Paper or Ask Questions

Shallow Learning for Fluid Flow Reconstruction with Limited Sensors and Limited Data

Feb 20, 2019
N. Benjamin Erichson, Lionel Mathelin, Zhewei Yao, Steven L. Brunton, Michael W. Mahoney, J. Nathan Kutz


  Access Paper or Ask Questions

Trust Region Based Adversarial Attack on Neural Networks

Dec 16, 2018
Zhewei Yao, Amir Gholami, Peng Xu, Kurt Keutzer, Michael Mahoney


  Access Paper or Ask Questions

Parameter Re-Initialization through Cyclical Batch Size Schedules

Dec 04, 2018
Norman Mu, Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney

* Presented in Systems for Machine Learning Workshop at NeurIPS'18 conference 

  Access Paper or Ask Questions

On the Computational Inefficiency of Large Batch Sizes for Stochastic Gradient Descent

Nov 30, 2018
Noah Golmant, Nikita Vemuri, Zhewei Yao, Vladimir Feinberg, Amir Gholami, Kai Rothauge, Michael W. Mahoney, Joseph Gonzalez


  Access Paper or Ask Questions

Large batch size training of neural networks with adversarial training and second-order information

Oct 02, 2018
Zhewei Yao, Amir Gholami, Kurt Keutzer, Michael Mahoney

* 17 pages 

  Access Paper or Ask Questions

Hessian-based Analysis of Large Batch Training and Robustness to Adversaries

Jun 18, 2018
Zhewei Yao, Amir Gholami, Qi Lei, Kurt Keutzer, Michael W. Mahoney

* 23 pages, 16 figures 

  Access Paper or Ask Questions