Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

Adapting BigScience Multilingual Model to Unseen Languages

Apr 11, 2022
Zheng-Xin Yong, Vassilina Nikoulina

Share this with someone who'll enjoy it:

We benchmark different strategies of adding new languages (German and Korean) into the BigScience's pretrained multilingual language model with 1.3 billion parameters that currently supports 13 languages. We investigate the factors that affect the language adaptability of the model and the trade-offs between computational costs and expected performance.

   Access Paper Source

Share this with someone who'll enjoy it: