Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Song Han

Song Han

PatchNet -- Short-range Template Matching for Efficient Video Processing

Mar 10, 2021
Huizi Mao, Sibo Zhu, Song Han, William J. Dally

Access Paper or Ask Questions

Anycost GANs for Interactive Image Synthesis and Editing

Mar 04, 2021
Ji Lin, Richard Zhang, Frieder Ganz, Song Han, Jun-Yan Zhu

Figure 1 for Anycost GANs for Interactive Image Synthesis and Editing

Figure 2 for Anycost GANs for Interactive Image Synthesis and Editing

Figure 3 for Anycost GANs for Interactive Image Synthesis and Editing

Figure 4 for Anycost GANs for Interactive Image Synthesis and Editing

* Accepted to CVPR 2021. The code and demo are available: https://github.com/mit-han-lab/anycost-gan

Access Paper or Ask Questions

SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Jan 04, 2021
Hanrui Wang, Zhekai Zhang, Song Han

Figure 1 for SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Figure 2 for SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Figure 3 for SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Figure 4 for SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

* Published as a conference paper in HPCA 2021; 15 pages, 23 figures

Access Paper or Ask Questions

IOS: Inter-Operator Scheduler for CNN Acceleration

Nov 02, 2020
Yaoyao Ding, Ligeng Zhu, Zhihao Jia, Gennady Pekhimenko, Song Han

Figure 1 for IOS: Inter-Operator Scheduler for CNN Acceleration

Figure 2 for IOS: Inter-Operator Scheduler for CNN Acceleration

Figure 3 for IOS: Inter-Operator Scheduler for CNN Acceleration

Figure 4 for IOS: Inter-Operator Scheduler for CNN Acceleration

Access Paper or Ask Questions

Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution

Aug 13, 2020
Haotian Tang, Zhijian Liu, Shengyu Zhao, Yujun Lin, Ji Lin, Hanrui Wang, Song Han

Figure 1 for Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution

Figure 2 for Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution

Figure 3 for Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution

Figure 4 for Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution

* ECCV 2020. The first two authors contributed equally to this work. Project page: http://spvnas.mit.edu/

Access Paper or Ask Questions

Hardware-Centric AutoML for Mixed-Precision Quantization

Aug 11, 2020
Kuan Wang, Zhijian Liu, Yujun Lin, Ji Lin, Song Han

Figure 1 for Hardware-Centric AutoML for Mixed-Precision Quantization

Figure 2 for Hardware-Centric AutoML for Mixed-Precision Quantization

Figure 3 for Hardware-Centric AutoML for Mixed-Precision Quantization

Figure 4 for Hardware-Centric AutoML for Mixed-Precision Quantization

* International Journal of Computer Vision (IJCV), 2020
* Journal preprint of arXiv:1811.08886 (IJCV, 2020). The first three authors contributed equally to this work. Project page: https://hanlab.mit.edu/projects/haq/

Access Paper or Ask Questions

Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning

Jul 28, 2020
Han Cai, Chuang Gan, Ligeng Zhu, Song Han

Figure 1 for Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning

Figure 2 for Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning

Figure 3 for Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning

Figure 4 for Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning

Access Paper or Ask Questions

MCUNet: Tiny Deep Learning on IoT Devices

Jul 20, 2020
Ji Lin, Wei-Ming Chen, Yujun Lin, John Cohn, Chuang Gan, Song Han

Figure 1 for MCUNet: Tiny Deep Learning on IoT Devices

Figure 2 for MCUNet: Tiny Deep Learning on IoT Devices

Figure 3 for MCUNet: Tiny Deep Learning on IoT Devices

Figure 4 for MCUNet: Tiny Deep Learning on IoT Devices

* Demo video available here: https://youtu.be/YvioBgtec4U

Access Paper or Ask Questions

Differentiable Augmentation for Data-Efficient GAN Training

Jun 18, 2020
Shengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu, Song Han

Figure 1 for Differentiable Augmentation for Data-Efficient GAN Training

Figure 2 for Differentiable Augmentation for Data-Efficient GAN Training

Figure 3 for Differentiable Augmentation for Data-Efficient GAN Training

Figure 4 for Differentiable Augmentation for Data-Efficient GAN Training

Access Paper or Ask Questions

APQ: Joint Search for Network Architecture, Pruning and Quantization Policy

Jun 15, 2020
Tianzhe Wang, Kuan Wang, Han Cai, Ji Lin, Zhijian Liu, Song Han

Figure 1 for APQ: Joint Search for Network Architecture, Pruning and Quantization Policy

Figure 2 for APQ: Joint Search for Network Architecture, Pruning and Quantization Policy

Figure 3 for APQ: Joint Search for Network Architecture, Pruning and Quantization Policy

Figure 4 for APQ: Joint Search for Network Architecture, Pruning and Quantization Policy

* Accepted by CVPR 2020

Access Paper or Ask Questions

HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

May 28, 2020
Hanrui Wang, Zhanghao Wu, Zhijian Liu, Han Cai, Ligeng Zhu, Chuang Gan, Song Han

Figure 1 for HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

Figure 2 for HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

Figure 3 for HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

Figure 4 for HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

* Accepted to ACL 2020. 14 pages, 12 figures. Code available at http://github.com/mit-han-lab/hardware-aware-transformers.git

Access Paper or Ask Questions

MicroNet for Efficient Language Modeling

May 16, 2020
Zhongxia Yan, Hanrui Wang, Demi Guo, Song Han

Figure 1 for MicroNet for Efficient Language Modeling

Figure 2 for MicroNet for Efficient Language Modeling

Figure 3 for MicroNet for Efficient Language Modeling

Figure 4 for MicroNet for Efficient Language Modeling

* Accepted by PMLR

Access Paper or Ask Questions

GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

Apr 30, 2020
Hanrui Wang, Kuan Wang, Jiacheng Yang, Linxiao Shen, Nan Sun, Hae-Seung Lee, Song Han

Figure 1 for GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

Figure 2 for GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

Figure 3 for GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

Figure 4 for GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning

* Accepted to the 57th Design Automation Conference (DAC 2020); 6 pages, 8 figures

Access Paper or Ask Questions

Lite Transformer with Long-Short Range Attention

Apr 24, 2020
Zhanghao Wu, Zhijian Liu, Ji Lin, Yujun Lin, Song Han

Figure 1 for Lite Transformer with Long-Short Range Attention

Figure 2 for Lite Transformer with Long-Short Range Attention

Figure 3 for Lite Transformer with Long-Short Range Attention

Figure 4 for Lite Transformer with Long-Short Range Attention

* ICLR 2020. The first two authors contributed equally to this work

Access Paper or Ask Questions

Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos

Oct 01, 2019
Ji Lin, Chuang Gan, Song Han

Figure 1 for Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos

Figure 2 for Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos

Figure 3 for Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos

Figure 4 for Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos

Access Paper or Ask Questions

Once for All: Train One Network and Specialize it for Efficient Deployment

Aug 26, 2019
Han Cai, Chuang Gan, Song Han

Figure 1 for Once for All: Train One Network and Specialize it for Efficient Deployment

Figure 2 for Once for All: Train One Network and Specialize it for Efficient Deployment

Figure 3 for Once for All: Train One Network and Specialize it for Efficient Deployment

Figure 4 for Once for All: Train One Network and Specialize it for Efficient Deployment

Access Paper or Ask Questions

Point-Voxel CNN for Efficient 3D Deep Learning

Jul 08, 2019
Zhijian Liu, Haotian Tang, Yujun Lin, Song Han

Figure 1 for Point-Voxel CNN for Efficient 3D Deep Learning

Figure 2 for Point-Voxel CNN for Efficient 3D Deep Learning

Figure 3 for Point-Voxel CNN for Efficient 3D Deep Learning

Figure 4 for Point-Voxel CNN for Efficient 3D Deep Learning

* The first two authors contributed equally to this work

Access Paper or Ask Questions

Deep Leakage from Gradients

Jun 21, 2019
Ligeng Zhu, Zhijian Liu, Song Han

Figure 1 for Deep Leakage from Gradients

Figure 2 for Deep Leakage from Gradients

Figure 3 for Deep Leakage from Gradients

Figure 4 for Deep Leakage from Gradients

Access Paper or Ask Questions

SysML: The New Frontier of Machine Learning Systems

May 01, 2019
Alexander Ratner, Dan Alistarh, Gustavo Alonso, David G. Andersen, Peter Bailis, Sarah Bird, Nicholas Carlini, Bryan Catanzaro, Jennifer Chayes, Eric Chung, Bill Dally, Jeff Dean, Inderjit S. Dhillon, Alexandros Dimakis, Pradeep Dubey, Charles Elkan, Grigori Fursin, Gregory R. Ganger, Lise Getoor, Phillip B. Gibbons, Garth A. Gibson, Joseph E. Gonzalez, Justin Gottschlich, Song Han, Kim Hazelwood, Furong Huang, Martin Jaggi, Kevin Jamieson, Michael I. Jordan, Gauri Joshi, Rania Khalaf, Jason Knight, Jakub Konečný, Tim Kraska, Arun Kumar, Anastasios Kyrillidis, Aparna Lakshmiratan, Jing Li, Samuel Madden, H. Brendan McMahan, Erik Meijer, Ioannis Mitliagkas, Rajat Monga, Derek Murray, Kunle Olukotun, Dimitris Papailiopoulos, Gennady Pekhimenko, Theodoros Rekatsinas, Afshin Rostamizadeh, Christopher Ré, Christopher De Sa, Hanie Sedghi, Siddhartha Sen, Virginia Smith, Alex Smola, Dawn Song, Evan Sparks, Ion Stoica, Vivienne Sze, Madeleine Udell, Joaquin Vanschoren, Shivaram Venkataraman, Rashmi Vinayak, Markus Weimer, Andrew Gordon Wilson, Eric Xing, Matei Zaharia, Ce Zhang, Ameet Talwalkar

Access Paper or Ask Questions

Defensive Quantization: When Efficiency Meets Robustness

Apr 17, 2019
Ji Lin, Chuang Gan, Song Han

Figure 1 for Defensive Quantization: When Efficiency Meets Robustness

Figure 2 for Defensive Quantization: When Efficiency Meets Robustness

Figure 3 for Defensive Quantization: When Efficiency Meets Robustness

Figure 4 for Defensive Quantization: When Efficiency Meets Robustness

Access Paper or Ask Questions

Learning to Design Circuits

Jan 17, 2019
Hanrui Wang, Jiacheng Yang, Hae-Seung Lee, Song Han

Figure 1 for Learning to Design Circuits

Figure 2 for Learning to Design Circuits

Figure 3 for Learning to Design Circuits

Figure 4 for Learning to Design Circuits

* The first two authors contributed equally to this work

Access Paper or Ask Questions

HAQ: Hardware-Aware Automated Quantization

Dec 06, 2018
Kuan Wang, Zhijian Liu, Yujun Lin, Ji Lin, Song Han

Figure 1 for HAQ: Hardware-Aware Automated Quantization

Figure 2 for HAQ: Hardware-Aware Automated Quantization

Figure 3 for HAQ: Hardware-Aware Automated Quantization

Figure 4 for HAQ: Hardware-Aware Automated Quantization

* The first three authors contributed equally to this work. Project page: https://hanlab.mit.edu/projects/haq/

Access Paper or Ask Questions

ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Dec 02, 2018
Han Cai, Ligeng Zhu, Song Han

Figure 1 for ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Figure 2 for ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Figure 3 for ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Figure 4 for ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

* Submitted to ICLR 2019

Access Paper or Ask Questions