Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Naman Goyal

Larger-Scale Transformers for Multilingual Masked Language Modeling


May 02, 2021
Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau

* 4 pages 

  Access Paper or Ask Questions

BASE Layers: Simplifying Training of Large, Sparse Models


Mar 30, 2021
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer


  Access Paper or Ask Questions

Multilingual Autoregressive Entity Linking


Mar 23, 2021
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni

* 20 pages, 8 figures, and 11 tables 

  Access Paper or Ask Questions

Facebook AI's WMT20 News Translation Task Submission


Nov 16, 2020
Peng-Jen Chen, Ann Lee, Changhan Wang, Naman Goyal, Angela Fan, Mary Williamson, Jiatao Gu


  Access Paper or Ask Questions

Beyond English-Centric Multilingual Machine Translation


Oct 21, 2020
Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Edouard Grave, Michael Auli, Armand Joulin


  Access Paper or Ask Questions

Better Fine-Tuning by Reducing Representational Collapse


Aug 06, 2020
Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta


  Access Paper or Ask Questions

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning


Aug 02, 2020
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan

* 10 pages (main) + 5 pages (appendices). 9 tables and 2 figures 

  Access Paper or Ask Questions

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks


May 22, 2020
Patrick Lewis, Ethan Perez, Aleksandara Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela


  Access Paper or Ask Questions

Recipes for building an open-domain chatbot


Apr 30, 2020
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston


  Access Paper or Ask Questions

Multilingual Denoising Pre-training for Neural Machine Translation


Jan 23, 2020
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer

* Work in progress 

  Access Paper or Ask Questions

Unsupervised Cross-lingual Representation Learning at Scale


Nov 05, 2019
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov

* 12 pages, 7 figures 

  Access Paper or Ask Questions

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension


Oct 29, 2019
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer


  Access Paper or Ask Questions

RoBERTa: A Robustly Optimized BERT Pretraining Approach


Jul 26, 2019
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov


  Access Paper or Ask Questions

The Social Dynamics of Language Change in Online Networks


Sep 07, 2016
Rahul Goel, Sandeep Soni, Naman Goyal, John Paparrizos, Hanna Wallach, Fernando Diaz, Jacob Eisenstein

* This paper appears in the Proceedings of the International Conference on Social Informatics (SocInfo16). The final publication is available at springer.com 

  Access Paper or Ask Questions