Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Mike Lewis

Sparse Distillation: Speeding Up Text Classification by Using Bigger Models


Oct 16, 2021
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech


  Access Paper or Ask Questions

Tricks for Training Sparse Translation Models


Oct 15, 2021
Dheeru Dua, Shruti Bhosale, Vedanuj Goswami, James Cross, Mike Lewis, Angela Fan


  Access Paper or Ask Questions

8-bit Optimizers via Block-wise Quantization


Oct 06, 2021
Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer

* ICLR2022 submission with appendix 

  Access Paper or Ask Questions

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation


Aug 27, 2021
Ofir Press, Noah A. Smith, Mike Lewis


  Access Paper or Ask Questions

DEMix Layers: Disentangling Domains for Modular Language Modeling


Aug 20, 2021
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer

* edits: updated reference links, added related work, typo fixes 

  Access Paper or Ask Questions

Noisy Channel Language Model Prompting for Few-Shot Text Classification


Aug 15, 2021
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer

* 15 pages, 6 figures 

  Access Paper or Ask Questions

HTLM: Hyper-Text Pre-Training and Prompting of Language Models


Jul 14, 2021
Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer


  Access Paper or Ask Questions

Question Answering Infused Pre-training of General-Purpose Contextualized Representations


Jun 15, 2021
Robin Jia, Mike Lewis, Luke Zettlemoyer


  Access Paper or Ask Questions

Multitasking Inhibits Semantic Drift


Apr 15, 2021
Athul Paul Jacob, Mike Lewis, Jacob Andreas

* NAACL 2021 

  Access Paper or Ask Questions

BASE Layers: Simplifying Training of Large, Sparse Models


Mar 30, 2021
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer


  Access Paper or Ask Questions

Shortformer: Better Language Modeling using Shorter Inputs


Dec 31, 2020
Ofir Press, Noah A. Smith, Mike Lewis


  Access Paper or Ask Questions

Joint Verification and Reranking for Open Fact Checking Over Tables


Dec 30, 2020
Michael Schlichtkrull, Vladimir Karpukhin, Barlas Oğuz, Mike Lewis, Wen-tau Yih, Sebastian Riedel


  Access Paper or Ask Questions

Nearest Neighbor Machine Translation


Oct 01, 2020
Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis


  Access Paper or Ask Questions

Conversational Semantic Parsing


Sep 28, 2020
Armen Aghajanyan, Jean Maillard, Akshat Shrivastava, Keith Diedrick, Mike Haeger, Haoran Li, Yashar Mehdad, Ves Stoyanov, Anuj Kumar, Mike Lewis, Sonal Gupta


  Access Paper or Ask Questions

Grounded Adaptation for Zero-shot Executable Semantic Parsing


Sep 17, 2020
Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer

* EMNLP 2020 long paper. 14 pages, 5 figures 

  Access Paper or Ask Questions

Pre-training via Paraphrasing


Jun 26, 2020
Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida Wang, Luke Zettlemoyer


  Access Paper or Ask Questions

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks


May 22, 2020
Patrick Lewis, Ethan Perez, Aleksandara Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela


  Access Paper or Ask Questions

Asking and Answering Questions to Evaluate the Factual Consistency of Summaries


Apr 08, 2020
Alex Wang, Kyunghyun Cho, Mike Lewis

* ACL 2020 

  Access Paper or Ask Questions

Multilingual Denoising Pre-training for Neural Machine Translation


Jan 23, 2020
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer

* Work in progress 

  Access Paper or Ask Questions

Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models


Nov 09, 2019
Siddharth Dalmia, Abdelrahman Mohamed, Mike Lewis, Florian Metze, Luke Zettlemoyer


  Access Paper or Ask Questions

Generalization through Memorization: Nearest Neighbor Language Models


Nov 01, 2019
Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis


  Access Paper or Ask Questions

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension


Oct 29, 2019
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer


  Access Paper or Ask Questions

RoBERTa: A Robustly Optimized BERT Pretraining Approach


Jul 26, 2019
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov


  Access Paper or Ask Questions

Hierarchical Decision Making by Generating and Following Natural Language Instructions


Jun 12, 2019
Hengyuan Hu, Denis Yarats, Qucheng Gong, Yuandong Tian, Mike Lewis


  Access Paper or Ask Questions

MelNet: A Generative Model for Audio in the Frequency Domain


Jun 04, 2019
Sean Vasquez, Mike Lewis


  Access Paper or Ask Questions

Improving Semantic Parsing for Task Oriented Dialog


Feb 15, 2019
Arash Einolghozati, Panupong Pasupat, Sonal Gupta, Rushin Shah, Mrinal Mohit, Mike Lewis, Luke Zettlemoyer


  Access Paper or Ask Questions

Strategies for Structuring Story Generation


Feb 04, 2019
Angela Fan, Mike Lewis, Yann Dauphin


  Access Paper or Ask Questions