Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


An Attentive Survey of Attention Models

Apr 05, 2019
Sneha Chaudhari, Gungor Polatkan, Rohan Ramanath, Varun Mithal


Share this with someone who'll enjoy it:


Attention Model has now become an important concept in neural networks that has been researched within diverse application domains. This survey provides a structured and comprehensive overview of the developments in modeling attention. In particular, we propose a taxonomy which groups existing techniques into coherent categories. We review the different neural architectures in which attention has been incorporated, and also show how attention improves interpretability of neural models. Finally, we discuss some applications in which modeling attention has a significant impact. We hope this survey will provide a succinct introduction to attention models and guide practitioners while developing approaches for their applications.

* submitted to IJCAI 2019 Survey Track; 6 pages, 4 figures, 2 tables 


   Access Paper Source



Share this with someone who'll enjoy it: