Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Orhan Firat

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets


Mar 22, 2021
Isaac Caswell, Julia Kreutzer, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Beno├«t Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Su├írez, Iroro Orife, Kelechi Ogueji, Rubungo Andre Niyongabo, Toan Q. Nguyen, Mathias M├╝ller, Andr├ę M├╝ller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine ├çabuk Ball─▒, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi

* 10 pages paper; 10 pages appendix; AfricaNLP 2021 

  Access Paper or Ask Questions

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution


Mar 11, 2021
Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat

* Accepted at NAACL 2021 

  Access Paper or Ask Questions

Gradient-guided Loss Masking for Neural Machine Translation


Feb 26, 2021
Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat


  Access Paper or Ask Questions

Rapid Domain Adaptation for Machine Translation with Monolingual Data


Oct 23, 2020
Mahdis Mahdieh, Mia Xu Chen, Yuan Cao, Orhan Firat


  Access Paper or Ask Questions

Towards End-to-End In-Image Neural Machine Translation


Oct 20, 2020
Elman Mansimov, Mitchell Stern, Mia Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain

* Accepted as an oral presentation at EMNLP, NLP Beyond Text workshop, 2020 

  Access Paper or Ask Questions

Complete Multilingual Neural Machine Translation


Oct 20, 2020
Markus Freitag, Orhan Firat

* Accepted at WMT 2020 

  Access Paper or Ask Questions

Explicit Alignment Objectives for Multilingual Bidirectional Encoders


Oct 15, 2020
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig


  Access Paper or Ask Questions

Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models


Oct 12, 2020
Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao


  Access Paper or Ask Questions

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages


Sep 23, 2020
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh


  Access Paper or Ask Questions

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding


Jun 30, 2020
Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen


  Access Paper or Ask Questions

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation


May 11, 2020
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

* ACL 2020 

  Access Paper or Ask Questions

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization


Apr 10, 2020
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson


  Access Paper or Ask Questions

On the Discrepancy between Density Estimation and Sequence Generation


Feb 17, 2020
Jason Lee, Dustin Tran, Orhan Firat, Kyunghyun Cho


  Access Paper or Ask Questions

Controlling Computation versus Quality for Neural Sequence Models


Feb 17, 2020
Ankur Bapna, Naveen Arivazhagan, Orhan Firat


  Access Paper or Ask Questions

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation


Oct 30, 2019
S├ębastien Jean, Ankur Bapna, Orhan Firat


  Access Paper or Ask Questions

On the Importance of Word Boundaries in Character-level Neural Machine Translation


Oct 21, 2019
Duygu Ataman, Orhan Firat, Mattia A. Di Gangi, Marcello Federico, Alexandra Birch

* To appear at the 3rd Workshop on Neural Generation and Translation (WNGT 2019) 

  Access Paper or Ask Questions

Simple, Scalable Adaptation for Neural Machine Translation


Sep 18, 2019
Ankur Bapna, Naveen Arivazhagan, Orhan Firat

* EMNLP 2019 

  Access Paper or Ask Questions

Adaptive Scheduling for Multi-Task Learning


Sep 13, 2019
S├ębastien Jean, Orhan Firat, Melvin Johnson

* Continual Learning Workshop at NeurIPS 2018 

  Access Paper or Ask Questions

Investigating Multilingual NMT Representations at Scale


Sep 11, 2019
Sneha Reddy Kudugunta, Ankur Bapna, Isaac Caswell, Naveen Arivazhagan, Orhan Firat

* Paper at EMNLP 2019 

  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation


Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman


  Access Paper or Ask Questions

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges


Jul 11, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu


  Access Paper or Ask Questions

Findings of the First Shared Task on Machine Translation Robustness


Jul 03, 2019
Xian Li, Paul Michel, Antonios Anastasopoulos, Yonatan Belinkov, Nadir Durrani, Orhan Firat, Philipp Koehn, Graham Neubig, Juan Pino, Hassan Sajjad


  Access Paper or Ask Questions

The Missing Ingredient in Zero-Shot Neural Machine Translation


Mar 17, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey


  Access Paper or Ask Questions

Massively Multilingual Neural Machine Translation


Feb 28, 2019
Roee Aharoni, Melvin Johnson, Orhan Firat

* Accepted as a long paper in NAACL 2019 

  Access Paper or Ask Questions

Non-Parametric Adaptation for Neural Machine Translation


Feb 28, 2019
Ankur Bapna, Orhan Firat

* To appear at NAACL 2019 

  Access Paper or Ask Questions

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling


Feb 21, 2019
Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia X. Chen, Ye Jia, Anjuli Kannan, Tara Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, S├ębastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel A. U. Bacchiani, Thomas B. Jablin, Rob Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon


  Access Paper or Ask Questions