Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox


Utilizing BERT Intermediate Layers for Aspect Based Sentiment Analysis and Natural Language Inference

Feb 12, 2020
Youwei Song, Jiahai Wang, Zhiwei Liang, Zhiyue Liu, Tao Jiang


Share this with someone who'll enjoy it:


Aspect based sentiment analysis aims to identify the sentimental tendency towards a given aspect in text. Fine-tuning of pretrained BERT performs excellent on this task and achieves state-of-the-art performances. Existing BERT-based works only utilize the last output layer of BERT and ignore the semantic knowledge in the intermediate layers. This paper explores the potential of utilizing BERT intermediate layers to enhance the performance of fine-tuning of BERT. To the best of our knowledge, no existing work has been done on this research. To show the generality, we also apply this approach to a natural language inference task. Experimental results demonstrate the effectiveness and generality of the proposed approach.

* 5 pages, 2 figures 


   Access Paper Source



Share this with someone who'll enjoy it: