Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Luke Zettlemoyer

DEMix Layers: Disentangling Domains for Modular Language Modeling


Aug 20, 2021
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer

* edits: updated reference links, added related work, typo fixes 

  Access Paper or Ask Questions

Noisy Channel Language Model Prompting for Few-Shot Text Classification


Aug 15, 2021
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer

* 15 pages, 6 figures 

  Access Paper or Ask Questions

Language Grounding with 3D Objects


Jul 26, 2021
Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer

* https://github.com/snaredataset/snare 

  Access Paper or Ask Questions

HTLM: Hyper-Text Pre-Training and Prompting of Language Models


Jul 14, 2021
Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer


  Access Paper or Ask Questions

FaVIQ: FAct Verification from Information-seeking Questions


Jul 05, 2021
Jungsoo Park, Sewon Min, Jaewoo Kang, Luke Zettlemoyer, Hannaneh Hajishirzi

* 12 pages, 3 figures; Data & Code available at https://faviq.github.io 

  Access Paper or Ask Questions

DESCGEN: A Distantly Supervised Dataset for Generating Abstractive Entity Descriptions


Jun 16, 2021
Weijia Shi, Mandar Joshi, Luke Zettlemoyer

* ACL-IJCNLP 2021 

  Access Paper or Ask Questions

Question Answering Infused Pre-training of General-Purpose Contextualized Representations


Jun 15, 2021
Robin Jia, Mike Lewis, Luke Zettlemoyer


  Access Paper or Ask Questions

Prompting Contrastive Explanations for Commonsense Reasoning Tasks


Jun 12, 2021
Bhargavi Paranjape, Julian Michael, Marjan Ghazvininejad, Luke Zettlemoyer, Hannaneh Hajishirzi

* ACL 2021 Findings 

  Access Paper or Ask Questions

DESCGEN: A Distantly Supervised Datasetfor Generating Abstractive Entity Descriptions


Jun 09, 2021
Weijia Shi, Mandar Joshi, Luke Zettlemoyer

* ACL-IJCNLP 2021 

  Access Paper or Ask Questions

Luna: Linear Unified Nested Attention


Jun 03, 2021
Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer

* Preprint. 2 figures, 6 tables 

  Access Paper or Ask Questions

VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding


May 20, 2021
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer

* 9 pages, ACL Findings 2021 

  Access Paper or Ask Questions

Surface Form Competition: Why the Highest Probability Answer Isn't Always Right


Apr 16, 2021
Ari Holtzman, Peter West, Vered Schwartz, Yejin Choi, Luke Zettlemoyer


  Access Paper or Ask Questions

BASE Layers: Simplifying Training of Large, Sparse Models


Mar 30, 2021
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer


  Access Paper or Ask Questions

Multilingual Autoregressive Entity Linking


Mar 23, 2021
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni

* 20 pages, 8 figures, and 11 tables 

  Access Paper or Ask Questions

FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary


Feb 16, 2021
Terra Blevins, Mandar Joshi, Luke Zettlemoyer

* EACL 2021 

  Access Paper or Ask Questions

Muppet: Massive Multi-task Representations with Pre-Finetuning


Jan 26, 2021
Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, Sonal Gupta


  Access Paper or Ask Questions

Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment


Jan 01, 2021
Haoyue Shi, Luke Zettlemoyer, Sida I. Wang


  Access Paper or Ask Questions

Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning


Dec 22, 2020
Armen Aghajanyan, Luke Zettlemoyer, Sonal Gupta


  Access Paper or Ask Questions

Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles


Nov 07, 2020
Christopher Clark, Mark Yatskar, Luke Zettlemoyer

* In EMNLP Findings 

  Access Paper or Ask Questions

Detecting Hallucinated Content in Conditional Neural Sequence Generation


Nov 05, 2020
Chunting Zhou, Jiatao Gu, Mona Diab, Paco Guzman, Luke Zettlemoyer, Marjan Ghazvininejad

* Under review 

  Access Paper or Ask Questions

Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing


Oct 07, 2020
Xilun Chen, Asish Ghoshal, Yashar Mehdad, Luke Zettlemoyer, Sonal Gupta

* EMNLP 2020 

  Access Paper or Ask Questions

Nearest Neighbor Machine Translation


Oct 01, 2020
Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis


  Access Paper or Ask Questions

Grounded Adaptation for Zero-shot Executable Semantic Parsing


Sep 17, 2020
Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer

* EMNLP 2020 long paper. 14 pages, 5 figures 

  Access Paper or Ask Questions

Better Fine-Tuning by Reducing Representational Collapse


Aug 06, 2020
Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta


  Access Paper or Ask Questions

DeLighT: Very Deep and Light-weight Transformer


Aug 03, 2020
Sachin Mehta, Marjan Ghazvininejad, Srinivasan Iyer, Luke Zettlemoyer, Hannaneh Hajishirzi

* 16 pages including references and appendix 

  Access Paper or Ask Questions

Pre-training via Paraphrasing


Jun 26, 2020
Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida Wang, Luke Zettlemoyer


  Access Paper or Ask Questions

Moving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoders


Jun 02, 2020
Terra Blevins, Luke Zettlemoyer

* Accepted to ACL 2020; current version corrects typos and formatting 

  Access Paper or Ask Questions

Active Learning for Coreference Resolution using Discrete Annotation


May 19, 2020
Belinda Z. Li, Gabriel Stanovsky, Luke Zettlemoyer

* 12 pages, 7 figures, ACL 2020 

  Access Paper or Ask Questions