Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Orhan Firat

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation


Apr 15, 2021
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson


  Access Paper or Ask Questions

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets


Mar 22, 2021
Isaac Caswell, Julia Kreutzer, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Beno├«t Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Su├írez, Iroro Orife, Kelechi Ogueji, Rubungo Andre Niyongabo, Toan Q. Nguyen, Mathias M├╝ller, Andr├ę M├╝ller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine ├çabuk Ball─▒, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi

* 10 pages paper; 10 pages appendix; AfricaNLP 2021 

  Access Paper or Ask Questions

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution


Mar 11, 2021
Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat

* Accepted at NAACL 2021 

  Access Paper or Ask Questions

Gradient-guided Loss Masking for Neural Machine Translation


Feb 26, 2021
Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat


  Access Paper or Ask Questions

Rapid Domain Adaptation for Machine Translation with Monolingual Data


Oct 23, 2020
Mahdis Mahdieh, Mia Xu Chen, Yuan Cao, Orhan Firat


  Access Paper or Ask Questions

Towards End-to-End In-Image Neural Machine Translation


Oct 20, 2020
Elman Mansimov, Mitchell Stern, Mia Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain

* Accepted as an oral presentation at EMNLP, NLP Beyond Text workshop, 2020 

  Access Paper or Ask Questions

Complete Multilingual Neural Machine Translation


Oct 20, 2020
Markus Freitag, Orhan Firat

* Accepted at WMT 2020 

  Access Paper or Ask Questions

Explicit Alignment Objectives for Multilingual Bidirectional Encoders


Oct 15, 2020
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig


  Access Paper or Ask Questions

Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models


Oct 12, 2020
Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao


  Access Paper or Ask Questions

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages


Sep 23, 2020
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh


  Access Paper or Ask Questions

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding


Jun 30, 2020
Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen


  Access Paper or Ask Questions

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation


May 11, 2020
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

* ACL 2020 

  Access Paper or Ask Questions

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization


Apr 10, 2020
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson


  Access Paper or Ask Questions

On the Discrepancy between Density Estimation and Sequence Generation


Feb 17, 2020
Jason Lee, Dustin Tran, Orhan Firat, Kyunghyun Cho


  Access Paper or Ask Questions

Controlling Computation versus Quality for Neural Sequence Models


Feb 17, 2020
Ankur Bapna, Naveen Arivazhagan, Orhan Firat


  Access Paper or Ask Questions

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation


Oct 30, 2019
S├ębastien Jean, Ankur Bapna, Orhan Firat


  Access Paper or Ask Questions

On the Importance of Word Boundaries in Character-level Neural Machine Translation


Oct 21, 2019
Duygu Ataman, Orhan Firat, Mattia A. Di Gangi, Marcello Federico, Alexandra Birch

* To appear at the 3rd Workshop on Neural Generation and Translation (WNGT 2019) 

  Access Paper or Ask Questions

Simple, Scalable Adaptation for Neural Machine Translation


Sep 18, 2019
Ankur Bapna, Naveen Arivazhagan, Orhan Firat

* EMNLP 2019 

  Access Paper or Ask Questions

Adaptive Scheduling for Multi-Task Learning


Sep 13, 2019
S├ębastien Jean, Orhan Firat, Melvin Johnson

* Continual Learning Workshop at NeurIPS 2018 

  Access Paper or Ask Questions

Investigating Multilingual NMT Representations at Scale


Sep 11, 2019
Sneha Reddy Kudugunta, Ankur Bapna, Isaac Caswell, Naveen Arivazhagan, Orhan Firat

* Paper at EMNLP 2019 

  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation


Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman


  Access Paper or Ask Questions

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges


Jul 11, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu


  Access Paper or Ask Questions

Findings of the First Shared Task on Machine Translation Robustness


Jul 03, 2019
Xian Li, Paul Michel, Antonios Anastasopoulos, Yonatan Belinkov, Nadir Durrani, Orhan Firat, Philipp Koehn, Graham Neubig, Juan Pino, Hassan Sajjad


  Access Paper or Ask Questions

The Missing Ingredient in Zero-Shot Neural Machine Translation


Mar 17, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey


  Access Paper or Ask Questions

Massively Multilingual Neural Machine Translation


Feb 28, 2019
Roee Aharoni, Melvin Johnson, Orhan Firat

* Accepted as a long paper in NAACL 2019 

  Access Paper or Ask Questions

Non-Parametric Adaptation for Neural Machine Translation


Feb 28, 2019
Ankur Bapna, Orhan Firat

* To appear at NAACL 2019 

  Access Paper or Ask Questions