Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Generating Descriptions for Sequential Images with Local-Object Attention and Global Semantic Context Modelling

Dec 02, 2020
Jing Su, Chenghua Lin, Mian Zhou, Qingyun Dai, Haoyu Lv

Share this with someone who'll enjoy it:

In this paper, we propose an end-to-end CNN-LSTM model for generating descriptions for sequential images with a local-object attention mechanism. To generate coherent descriptions, we capture global semantic context using a multi-layer perceptron, which learns the dependencies between sequential images. A paralleled LSTM network is exploited for decoding the sequence descriptions. Experimental results show that our model outperforms the baseline across three different evaluation metrics on the datasets published by Microsoft.

* Accepted by INLG 2018 

   Access Paper Source

Share this with someone who'll enjoy it: