Alert button

Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification

Apr 20, 2022
Dawei Zhu, Michael A. Hedderich, Fangzhou Zhai, David Ifeoluwa Adelani, Dietrich Klakow

Figure 1 for Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
Figure 2 for Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
Figure 3 for Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
Figure 4 for Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification

Share this with someone who'll enjoy it:

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the noisy instances - are required to prevent models from fitting this label noise. However, we show in this work that, for text classification tasks with modern NLP models like BERT, over a variety of noise types, existing noisehandling methods do not always improve its performance, and may even deteriorate it, suggesting the need for further investigation. We also back our observations with a comprehensive analysis.

* Accepted at Workshop on Insights from Negative Results in NLP 2022 @ACL 2022  
View paper onarxiv icon

Share this with someone who'll enjoy it: