Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Pre-trained Language Model Based Active Learning for Sentence Matching

Oct 12, 2020
Guirong Bai, Shizhu He, Kang Liu, Jun Zhao, Zaiqing Nie


Share this with someone who'll enjoy it:


Active learning is able to significantly reduce the annotation cost for data-driven techniques. However, previous active learning approaches for natural language processing mainly depend on the entropy-based uncertainty criterion, and ignore the characteristics of natural language. In this paper, we propose a pre-trained language model based active learning approach for sentence matching. Differing from previous active learning, it can provide linguistic criteria to measure instances and help select more efficient instances for annotation. Experiments demonstrate our approach can achieve greater accuracy with fewer labeled training instances.

* Accepted by the conference of coling 2020 


   Access Paper Source



Share this with someone who'll enjoy it: