Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Lightweight Convolutional Representations for On-Device Natural Language Processing

Feb 04, 2020
Shrey Desai, Geoffrey Goh, Arun Babu, Ahmed Aly

Share this with someone who'll enjoy it:

The increasing computational and memory complexities of deep neural networks have made it difficult to deploy them on low-resource electronic devices (e.g., mobile phones, tablets, wearables). Practitioners have developed numerous model compression methods to address these concerns, but few have condensed input representations themselves. In this work, we propose a fast, accurate, and lightweight convolutional representation that can be swapped into any neural model and compressed significantly (up to 32x) with a negligible reduction in performance. In addition, we show gains over recurrent representations when considering resource-centric metrics (e.g., model file size, latency, memory usage) on a Samsung Galaxy S9.

* Accepted to MLSys 2020 

   Access Paper Source

Share this with someone who'll enjoy it: