Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


The Unstoppable Rise of Computational Linguistics in Deep Learning

May 13, 2020
James Henderson


Share this with someone who'll enjoy it:


In this paper, we trace the history of neural networks applied to natural language understanding tasks, and identify key contributions which the nature of language has made to the development of neural network architectures. We focus on the importance of variable binding and its instantiation in attention-based models, and argue that Transformer is not a sequence model but an induced-structure model. This perspective leads to predictions of the challenges facing research in deep learning architectures for natural language understanding.

* 13 pages. Accepted for publication at ACL 2020, in the theme track 


   Access Paper Source



Share this with someone who'll enjoy it: