Learning to Prune Deep Neural Networks via Reinforcement Learning: Paper and Code

Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

Learning to Prune Deep Neural Networks via Reinforcement Learning

Jul 09, 2020
Manas Gupta, Siddharth Aravindan, Aleksandra Kalisz, Vijay Chandrasekhar, Lin Jie

Figure 1 for Learning to Prune Deep Neural Networks via Reinforcement Learning

Figure 2 for Learning to Prune Deep Neural Networks via Reinforcement Learning

Figure 3 for Learning to Prune Deep Neural Networks via Reinforcement Learning

Figure 4 for Learning to Prune Deep Neural Networks via Reinforcement Learning

Share this with someone who'll enjoy it:

This paper proposes PuRL - a deep reinforcement learning (RL) based algorithm for pruning neural networks. Unlike current RL based model compression approaches where feedback is given only at the end of each episode to the agent, PuRL provides rewards at every pruning step. This enables PuRL to achieve sparsity and accuracy comparable to current state-of-the-art methods, while having a much shorter training cycle. PuRL achieves more than 80% sparsity on the ResNet-50 model while retaining a Top-1 accuracy of 75.37% on the ImageNet dataset. Through our experiments we show that PuRL is also able to sparsify already efficient architectures like MobileNet-V2. In addition to performance characterisation experiments, we also provide a discussion and analysis of the various RL design choices that went into the tuning of the Markov Decision Process underlying PuRL. Lastly, we point out that PuRL is simple to use and can be easily adapted for various architectures.

* Accepted at the ICML 2020 Workshop on Automated Machine Learning (AutoML 2020)

View paper on

Share this with someone who'll enjoy it: