Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

On the Role of Bidirectionality in Language Model Pre-Training



Mikel Artetxe , Jingfei Du , Naman Goyal , Luke Zettlemoyer , Ves Stoyanov


   Access Paper or Ask Questions

Efficient Language Modeling with Sparse all-MLP



Ping Yu , Mikel Artetxe , Myle Ott , Sam Shleifer , Hongyu Gong , Ves Stoyanov , Xian Li


   Access Paper or Ask Questions

Efficient Large Scale Language Modeling with Mixtures of Experts



Mikel Artetxe , Shruti Bhosale , Naman Goyal , Todor Mihaylov , Myle Ott , Sam Shleifer , Xi Victoria Lin , Jingfei Du , Srinivasan Iyer , Ramakanth Pasunuru , Giri Anantharaman , Xian Li , Shuohui Chen , Halil Akin , Mandeep Baines , Louis Martin , Xing Zhou , Punit Singh Koura , Brian O'Horo , Jeff Wang , Luke Zettlemoyer , Mona Diab , Zornitsa Kozareva , Ves Stoyanov


   Access Paper or Ask Questions

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning



Beliz Gunel , Jingfei Du , Alexis Conneau , Ves Stoyanov


   Access Paper or Ask Questions

Self-training Improves Pre-training for Natural Language Understanding



Jingfei Du , Edouard Grave , Beliz Gunel , Vishrav Chaudhary , Onur Celebi , Michael Auli , Ves Stoyanov , Alexis Conneau

* 8 pages 

   Access Paper or Ask Questions

Conversational Semantic Parsing



Armen Aghajanyan , Jean Maillard , Akshat Shrivastava , Keith Diedrick , Mike Haeger , Haoran Li , Yashar Mehdad , Ves Stoyanov , Anuj Kumar , Mike Lewis , Sonal Gupta


   Access Paper or Ask Questions

Preserving Integrity in Online Social Networks



Alon Halevy , Cristian Canton Ferrer , Hao Ma , Umut Ozertem , Patrick Pantel , Marzieh Saeidi , Fabrizio Silvestri , Ves Stoyanov


   Access Paper or Ask Questions

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension



Mike Lewis , Yinhan Liu , Naman Goyal , Marjan Ghazvininejad , Abdelrahman Mohamed , Omer Levy , Ves Stoyanov , Luke Zettlemoyer


   Access Paper or Ask Questions