Recipes for building an open-domain chatbot

Apr 30, 2020
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston


  Access Model/Code and Paper
Multilingual Denoising Pre-training for Neural Machine Translation

Jan 23, 2020
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer

* Work in progress 

  Access Model/Code and Paper
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

Oct 29, 2019
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer


  Access Model/Code and Paper
SpanBERT: Improving Pre-training by Representing and Predicting Spans

Jul 31, 2019
Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, Omer Levy


  Access Model/Code and Paper
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Jul 26, 2019
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov


  Access Model/Code and Paper
Constant-Time Machine Translation with Conditional Masked Language Models

Apr 19, 2019
Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer


  Access Model/Code and Paper
Cloze-driven Pretraining of Self-attention Networks

Mar 19, 2019
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli


  Access Model/Code and Paper