Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Minyi Guo

Minyi Guo

Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training

Sep 22, 2022
Cong Guo, Yuxian Qiu, Jingwen Leng, Chen Zhang, Ying Cao, Quanlu Zhang, Yunxin Liu, Fan Yang, Minyi Guo

Figure 1 for Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training

Figure 2 for Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training

Figure 3 for Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training

Figure 4 for Nesting Forward Automatic Differentiation for Memory-Efficient Deep Neural Network Training

* 8 pages, ICCD 2022

Access Paper or Ask Questions

ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization

Aug 30, 2022
Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

Figure 1 for ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization

Figure 2 for ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization

Figure 3 for ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization

Figure 4 for ANT: Exploiting Adaptive Numerical Data Type for Low-bit Deep Neural Network Quantization

* 20 pages, accepted by MICRO 2022

Access Paper or Ask Questions

SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences

Jun 29, 2022
Guan Shen, Jieru Zhao, Quan Chen, Jingwen Leng, Chao Li, Minyi Guo

Figure 1 for SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences

Figure 2 for SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences

Figure 3 for SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences

Figure 4 for SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences

* Accepted by 59th DAC

Access Paper or Ask Questions

Transkimmer: Transformer Learns to Layer-wise Skim

May 15, 2022
Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, Minyi Guo

Figure 1 for Transkimmer: Transformer Learns to Layer-wise Skim

Figure 2 for Transkimmer: Transformer Learns to Layer-wise Skim

Figure 3 for Transkimmer: Transformer Learns to Layer-wise Skim

Figure 4 for Transkimmer: Transformer Learns to Layer-wise Skim

* Published as a conference paper at ACL 2022

Access Paper or Ask Questions

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Feb 14, 2022
Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

Figure 1 for SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Figure 2 for SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Figure 3 for SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Figure 4 for SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

* 18 pages, 2 figures, ICLR 2022

Access Paper or Ask Questions

Block-Skim: Efficient Question Answering for Transformer

Dec 16, 2021
Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, Minyi Guo, Yuhao Zhu

Figure 1 for Block-Skim: Efficient Question Answering for Transformer

Figure 2 for Block-Skim: Efficient Question Answering for Transformer

Figure 3 for Block-Skim: Efficient Question Answering for Transformer

Figure 4 for Block-Skim: Efficient Question Answering for Transformer

* Published as a conference paper at AAAI 2022

Access Paper or Ask Questions

Architectural Implications of Graph Neural Networks

Sep 02, 2020
Zhihui Zhang, Jingwen Leng, Lingxiao Ma, Youshan Miao, Chao Li, Minyi Guo

Figure 1 for Architectural Implications of Graph Neural Networks

Figure 2 for Architectural Implications of Graph Neural Networks

Figure 3 for Architectural Implications of Graph Neural Networks

Figure 4 for Architectural Implications of Graph Neural Networks

* in IEEE Computer Architecture Letters, vol. 19, no. 1, pp. 59-62, 1 Jan.-June 2020
* 4 pages, published in IEEE Computer Architecture Letters (CAL) 2020

Access Paper or Ask Questions