Alert button

Improving Relation Extraction with Knowledge-attention

Oct 07, 2019
Pengfei Li, Kezhi Mao, Xuefeng Yang, Qi Li

Figure 1 for Improving Relation Extraction with Knowledge-attention
Figure 2 for Improving Relation Extraction with Knowledge-attention
Figure 3 for Improving Relation Extraction with Knowledge-attention
Figure 4 for Improving Relation Extraction with Knowledge-attention

Share this with someone who'll enjoy it:

While attention mechanisms have been proven to be effective in many NLP tasks, majority of them are data-driven. We propose a novel knowledge-attention encoder which incorporates prior knowledge from external lexical resources into deep neural networks for relation extraction task. Furthermore, we present three effective ways of integrating knowledge-attention with self-attention to maximize the utilization of both knowledge and data. The proposed relation extraction system is end-to-end and fully attention-based. Experiment results show that the proposed knowledge-attention mechanism has complementary strengths with self-attention, and our integrated models outperform existing CNN, RNN, and self-attention based models. State-of-the-art performance is achieved on TACRED, a complex and large-scale relation extraction dataset.

* Accepted paper appearing at 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP)  
View paper onarxiv icon

Share this with someone who'll enjoy it: