Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Luke Zettlemoyer

Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection


Jan 25, 2022
Suchin Gururangan, Dallas Card, Sarah K. Drier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith


  Access Paper or Ask Questions

UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models


Jan 20, 2022
Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I. Wang, Victor Zhong, Bailin Wang, Chengzu Li, Connor Boyle, Ansong Ni, Ziyu Yao, Dragomir Radev, Caiming Xiong, Lingpeng Kong, Rui Zhang, Noah A. Smith, Luke Zettlemoyer, Tao Yu


  Access Paper or Ask Questions

CM3: A Causal Masked Multimodal Model of the Internet


Jan 19, 2022
Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer


  Access Paper or Ask Questions

Efficient Large Scale Language Modeling with Mixtures of Experts


Dec 20, 2021
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona Diab, Zornitsa Kozareva, Ves Stoyanov


  Access Paper or Ask Questions

Few-shot Learning with Multilingual Language Models


Dec 20, 2021
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyanov, Xian Li

* 36 pages 

  Access Paper or Ask Questions

Reducing Target Group Bias in Hate Speech Detectors


Dec 07, 2021
Darsh J Shah, Sinong Wang, Han Fang, Hao Ma, Luke Zettlemoyer


  Access Paper or Ask Questions

Quantifying Adaptability in Pre-trained Language Models with 500 Tasks


Dec 06, 2021
Belinda Z. Li, Jane Yu, Madian Khabsa, Luke Zettlemoyer, Alon Halevy, Jacob Andreas

* 18 pages, 5 figures, 8 tables 

  Access Paper or Ask Questions

BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation


Nov 12, 2021
Eleftheria Briakou, Sida I. Wang, Luke Zettlemoyer, Marjan Ghazvininejad


  Access Paper or Ask Questions

MetaICL: Learning to Learn In Context


Oct 29, 2021
Sewon Min, Mike Lewis, Luke Zettlemoyer, Hannaneh Hajishirzi

* 18 pages (9 pages for the main paper, 9 pages for references and appendices). 1 figure. Code available at https://github.com/facebookresearch/MetaICL 

  Access Paper or Ask Questions

SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark


Oct 20, 2021
Victor Zhong, Austin W. Hanjie, Sida I. Wang, Karthik Narasimhan, Luke Zettlemoyer

* NeurIPS 2021. 14 pages, 8 figures 

  Access Paper or Ask Questions

8-bit Optimizers via Block-wise Quantization


Oct 06, 2021
Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer

* ICLR2022 submission with appendix 

  Access Paper or Ask Questions

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding


Oct 01, 2021
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer

* EMNLP 2021 

  Access Paper or Ask Questions

DEMix Layers: Disentangling Domains for Modular Language Modeling


Aug 20, 2021
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer

* edits: updated reference links, added related work, typo fixes 

  Access Paper or Ask Questions

Noisy Channel Language Model Prompting for Few-Shot Text Classification


Aug 15, 2021
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer

* 15 pages, 6 figures 

  Access Paper or Ask Questions

Language Grounding with 3D Objects


Jul 26, 2021
Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer

* https://github.com/snaredataset/snare 

  Access Paper or Ask Questions

HTLM: Hyper-Text Pre-Training and Prompting of Language Models


Jul 14, 2021
Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer


  Access Paper or Ask Questions

FaVIQ: FAct Verification from Information-seeking Questions


Jul 05, 2021
Jungsoo Park, Sewon Min, Jaewoo Kang, Luke Zettlemoyer, Hannaneh Hajishirzi

* 12 pages, 3 figures; Data & Code available at https://faviq.github.io 

  Access Paper or Ask Questions

DESCGEN: A Distantly Supervised Dataset for Generating Abstractive Entity Descriptions


Jun 16, 2021
Weijia Shi, Mandar Joshi, Luke Zettlemoyer

* ACL-IJCNLP 2021 

  Access Paper or Ask Questions

Question Answering Infused Pre-training of General-Purpose Contextualized Representations


Jun 15, 2021
Robin Jia, Mike Lewis, Luke Zettlemoyer


  Access Paper or Ask Questions

Prompting Contrastive Explanations for Commonsense Reasoning Tasks


Jun 12, 2021
Bhargavi Paranjape, Julian Michael, Marjan Ghazvininejad, Luke Zettlemoyer, Hannaneh Hajishirzi

* ACL 2021 Findings 

  Access Paper or Ask Questions

DESCGEN: A Distantly Supervised Datasetfor Generating Abstractive Entity Descriptions


Jun 09, 2021
Weijia Shi, Mandar Joshi, Luke Zettlemoyer

* ACL-IJCNLP 2021 

  Access Paper or Ask Questions

Luna: Linear Unified Nested Attention


Jun 03, 2021
Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer

* Preprint. 2 figures, 6 tables 

  Access Paper or Ask Questions

VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding


May 20, 2021
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer

* 9 pages, ACL Findings 2021 

  Access Paper or Ask Questions

Surface Form Competition: Why the Highest Probability Answer Isn't Always Right


Apr 16, 2021
Ari Holtzman, Peter West, Vered Schwartz, Yejin Choi, Luke Zettlemoyer


  Access Paper or Ask Questions

BASE Layers: Simplifying Training of Large, Sparse Models


Mar 30, 2021
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer


  Access Paper or Ask Questions

Multilingual Autoregressive Entity Linking


Mar 23, 2021
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni

* 20 pages, 8 figures, and 11 tables 

  Access Paper or Ask Questions

FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary


Feb 16, 2021
Terra Blevins, Mandar Joshi, Luke Zettlemoyer

* EACL 2021 

  Access Paper or Ask Questions