Alert button

Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization

Sep 15, 2019
Wataru Hirota, Yoshihiko Suhara, Behzad Golshan, Wang-Chiew Tan

Figure 1 for Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization
Figure 2 for Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization
Figure 3 for Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization
Figure 4 for Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization

Share this with someone who'll enjoy it:

We present Emu, a system that semantically enhances multilingual sentence embeddings. Our framework fine-tunes pre-trained multilingual sentence embeddings using two main components: a semantic classifier and a language discriminator. The semantic classifier improves the semantic similarity of related sentences, whereas the language discriminator enhances the multilinguality of the embeddings via multilingual adversarial training. Our experimental results based on several language pairs show that our specialized embeddings outperform the state-of-the-art multilingual sentence embedding model on the task of cross-lingual intent classification using only monolingual labeled data.

View paper onarxiv icon

Share this with someone who'll enjoy it: