Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Ankur Bapna

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference


Sep 24, 2021
Sneha Kudugunta, Yanping Huang, Ankur Bapna, Maxim Krikun, Dmitry Lepikhin, Minh-Thang Luong, Orhan Firat

* EMNLP Findings 2021 

  Access Paper or Ask Questions

Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents


Sep 21, 2021
Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat


  Access Paper or Ask Questions

Scaling Laws for Neural Machine Translation


Sep 16, 2021
Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry

* 31 pages, 23 figures 

  Access Paper or Ask Questions

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets


Mar 22, 2021
Isaac Caswell, Julia Kreutzer, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Rubungo Andre Niyongabo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Ballı, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi

* 10 pages paper; 10 pages appendix; AfricaNLP 2021 

  Access Paper or Ask Questions

Gradient-guided Loss Masking for Neural Machine Translation


Feb 26, 2021
Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat


  Access Paper or Ask Questions

Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus


Oct 29, 2020
Isaac Caswell, Theresa Breiner, Daan van Esch, Ankur Bapna

* Accepted to COLING 2020. 9 pages with 8 page abstract 

  Access Paper or Ask Questions

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation


May 11, 2020
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

* ACL 2020 

  Access Paper or Ask Questions

Controlling Computation versus Quality for Neural Sequence Models


Feb 17, 2020
Ankur Bapna, Naveen Arivazhagan, Orhan Firat


  Access Paper or Ask Questions

Faster Transformer Decoding: N-gram Masked Self-Attention


Jan 14, 2020
Ciprian Chelba, Mia Chen, Ankur Bapna, Noam Shazeer


  Access Paper or Ask Questions

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation


Oct 30, 2019
Sébastien Jean, Ankur Bapna, Orhan Firat


  Access Paper or Ask Questions

Simple, Scalable Adaptation for Neural Machine Translation


Sep 18, 2019
Ankur Bapna, Naveen Arivazhagan, Orhan Firat

* EMNLP 2019 

  Access Paper or Ask Questions

Investigating Multilingual NMT Representations at Scale


Sep 11, 2019
Sneha Reddy Kudugunta, Ankur Bapna, Isaac Caswell, Naveen Arivazhagan, Orhan Firat

* Paper at EMNLP 2019 

  Access Paper or Ask Questions

Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model


Sep 11, 2019
Anjuli Kannan, Arindrima Datta, Tara N. Sainath, Eugene Weinstein, Bhuvana Ramabhadran, Yonghui Wu, Ankur Bapna, Zhifeng Chen, Seungji Lee

* Accepted in Interspeech 2019 

  Access Paper or Ask Questions

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation


Sep 01, 2019
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman


  Access Paper or Ask Questions

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges


Jul 11, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu


  Access Paper or Ask Questions

The Missing Ingredient in Zero-Shot Neural Machine Translation


Mar 17, 2019
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey


  Access Paper or Ask Questions

Non-Parametric Adaptation for Neural Machine Translation


Feb 28, 2019
Ankur Bapna, Orhan Firat

* To appear at NAACL 2019 

  Access Paper or Ask Questions

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling


Feb 21, 2019
Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia X. Chen, Ye Jia, Anjuli Kannan, Tara Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel A. U. Bacchiani, Thomas B. Jablin, Rob Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon


  Access Paper or Ask Questions

Training Deeper Neural Machine Translation Models with Transparent Attention


Sep 04, 2018
Ankur Bapna, Mia Xu Chen, Orhan Firat, Yuan Cao, Yonghui Wu

* To appear in EMNLP 2018 

  Access Paper or Ask Questions

Revisiting Character-Based Neural Machine Translation with Capacity and Compression


Aug 29, 2018
Colin Cherry, George Foster, Ankur Bapna, Orhan Firat, Wolfgang Macherey

* To appear at EMNLP 2018 

  Access Paper or Ask Questions

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation


Apr 27, 2018
Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Niki Parmar, Mike Schuster, Zhifeng Chen, Yonghui Wu, Macduff Hughes


  Access Paper or Ask Questions

Building a Conversational Agent Overnight with Dialogue Self-Play


Jan 15, 2018
Pararth Shah, Dilek Hakkani-Tür, Gokhan Tür, Abhinav Rastogi, Ankur Bapna, Neha Nayak, Larry Heck

* 11 pages, 4 figures 

  Access Paper or Ask Questions

Sequential Dialogue Context Modeling for Spoken Language Understanding


Jul 07, 2017
Ankur Bapna, Gokhan Tur, Dilek Hakkani-Tur, Larry Heck

* 8 + 2 pages, Updated 10/17: Updated typos in abstract, Updated 07/07: Updated Title, abstract and few minor changes 

  Access Paper or Ask Questions

Towards Zero-Shot Frame Semantic Parsing for Domain Scaling


Jul 07, 2017
Ankur Bapna, Gokhan Tur, Dilek Hakkani-Tur, Larry Heck

* 4 pages + 1 references 

  Access Paper or Ask Questions