Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension

Sep 29, 2020
Huaishao Luo, Yu Shi, Ming Gong, Linjun Shou, Tianrui Li


Share this with someone who'll enjoy it:


Span extraction is an essential problem in machine reading comprehension. Most of the existing algorithms predict the start and end positions of an answer span in the given corresponding context by generating two probability vectors. In this paper, we propose a novel approach that extends the probability vector to a probability matrix. Such a matrix can cover more start-end position pairs. Precisely, to each possible start index, the method always generates an end probability vector. Besides, we propose a sampling-based training strategy to address the computational cost and memory issue in the matrix training phase. We evaluate our method on SQuAD 1.1 and three other question answering benchmarks. Leveraging the most competitive models BERT and BiDAF as the backbone, our proposed approach can get consistent improvements in all datasets, demonstrating the effectiveness of the proposed method.

* to appear at AACL-IJCNLP 2020 


   Access Paper Source



Share this with someone who'll enjoy it: