Alert button
Picture for Mike Lewis

Mike Lewis

Alert button

LegoNN: Building Modular Encoder-Decoder Models

Jun 07, 2022
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed

Figure 1 for LegoNN: Building Modular Encoder-Decoder Models
Figure 2 for LegoNN: Building Modular Encoder-Decoder Models
Figure 3 for LegoNN: Building Modular Encoder-Decoder Models
Figure 4 for LegoNN: Building Modular Encoder-Decoder Models
Viaarxiv icon

Few-shot Mining of Naturally Occurring Inputs and Outputs

May 09, 2022
Mandar Joshi, Terra Blevins, Mike Lewis, Daniel S. Weld, Luke Zettlemoyer

Figure 1 for Few-shot Mining of Naturally Occurring Inputs and Outputs
Figure 2 for Few-shot Mining of Naturally Occurring Inputs and Outputs
Figure 3 for Few-shot Mining of Naturally Occurring Inputs and Outputs
Figure 4 for Few-shot Mining of Naturally Occurring Inputs and Outputs
Viaarxiv icon

InCoder: A Generative Model for Code Infilling and Synthesis

Apr 17, 2022
Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Wen-tau Yih, Luke Zettlemoyer, Mike Lewis

Figure 1 for InCoder: A Generative Model for Code Infilling and Synthesis
Figure 2 for InCoder: A Generative Model for Code Infilling and Synthesis
Figure 3 for InCoder: A Generative Model for Code Infilling and Synthesis
Figure 4 for InCoder: A Generative Model for Code Infilling and Synthesis
Viaarxiv icon

Improving Passage Retrieval with Zero-Shot Question Generation

Apr 15, 2022
Devendra Singh Sachan, Mike Lewis, Mandar Joshi, Armen Aghajanyan, Wen-tau Yih, Joelle Pineau, Luke Zettlemoyer

Figure 1 for Improving Passage Retrieval with Zero-Shot Question Generation
Figure 2 for Improving Passage Retrieval with Zero-Shot Question Generation
Figure 3 for Improving Passage Retrieval with Zero-Shot Question Generation
Figure 4 for Improving Passage Retrieval with Zero-Shot Question Generation
Viaarxiv icon

Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

Feb 25, 2022
Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer

Figure 1 for Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Figure 2 for Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Figure 3 for Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Figure 4 for Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Viaarxiv icon

CM3: A Causal Masked Multimodal Model of the Internet

Jan 19, 2022
Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer

Figure 1 for CM3: A Causal Masked Multimodal Model of the Internet
Figure 2 for CM3: A Causal Masked Multimodal Model of the Internet
Figure 3 for CM3: A Causal Masked Multimodal Model of the Internet
Figure 4 for CM3: A Causal Masked Multimodal Model of the Internet
Viaarxiv icon

MetaICL: Learning to Learn In Context

Oct 29, 2021
Sewon Min, Mike Lewis, Luke Zettlemoyer, Hannaneh Hajishirzi

Figure 1 for MetaICL: Learning to Learn In Context
Figure 2 for MetaICL: Learning to Learn In Context
Figure 3 for MetaICL: Learning to Learn In Context
Figure 4 for MetaICL: Learning to Learn In Context
Viaarxiv icon

Sparse Distillation: Speeding Up Text Classification by Using Bigger Models

Oct 16, 2021
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech

Figure 1 for Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Figure 2 for Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Figure 3 for Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Figure 4 for Sparse Distillation: Speeding Up Text Classification by Using Bigger Models
Viaarxiv icon

Tricks for Training Sparse Translation Models

Oct 15, 2021
Dheeru Dua, Shruti Bhosale, Vedanuj Goswami, James Cross, Mike Lewis, Angela Fan

Figure 1 for Tricks for Training Sparse Translation Models
Figure 2 for Tricks for Training Sparse Translation Models
Figure 3 for Tricks for Training Sparse Translation Models
Figure 4 for Tricks for Training Sparse Translation Models
Viaarxiv icon