Alert button

Multilingual Constituency Parsing with Self-Attention and Pre-Training

Add code
Bookmark button
Alert button
Dec 31, 2018
Nikita Kitaev, Dan Klein

Figure 1 for Multilingual Constituency Parsing with Self-Attention and Pre-Training
Figure 2 for Multilingual Constituency Parsing with Self-Attention and Pre-Training
Figure 3 for Multilingual Constituency Parsing with Self-Attention and Pre-Training
Figure 4 for Multilingual Constituency Parsing with Self-Attention and Pre-Training

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

We extend our previous work on constituency parsing (Kitaev and Klein, 2018) by incorporating pre-training for ten additional languages, and compare the benefits of no pre-training, ELMo (Peters et al., 2018), and BERT (Devlin et al., 2018). Pre-training is effective across all languages evaluated, and BERT outperforms ELMo in large part due to the benefits of increased model capacity. Our parser obtains new state-of-the-art results for 11 languages, including English (95.8 F1) and Chinese (91.8 F1).

View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon