Alert button

Natural Language Processing with Small Feed-Forward Networks

Aug 01, 2017
Jan A. Botha, Emily Pitler, Ji Ma, Anton Bakalov, Alex Salcianu, David Weiss, Ryan McDonald, Slav Petrov

Figure 1 for Natural Language Processing with Small Feed-Forward Networks
Figure 2 for Natural Language Processing with Small Feed-Forward Networks
Figure 3 for Natural Language Processing with Small Feed-Forward Networks
Figure 4 for Natural Language Processing with Small Feed-Forward Networks

Share this with someone who'll enjoy it:

We show that small and shallow feed-forward neural networks can achieve near state-of-the-art results on a range of unstructured and structured language processing tasks while being considerably cheaper in memory and computational requirements than deep recurrent models. Motivated by resource-constrained environments like mobile phones, we showcase simple techniques for obtaining such small neural network models, and investigate different tradeoffs when deciding how to allocate a small memory budget.

* EMNLP 2017 short paper  
View paper onarxiv icon

Share this with someone who'll enjoy it: