Alert button

How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

Dec 31, 2020
Phillip Rust, Jonas Pfeiffer, Ivan Vulić, Sebastian Ruder, Iryna Gurevych

Figure 1 for How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
Figure 2 for How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
Figure 3 for How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
Figure 4 for How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: