Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Noah A. Smith

Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection


Jan 25, 2022
Suchin Gururangan, Dallas Card, Sarah K. Drier, Emily K. Gade, Leroy Z. Wang, Zeyu Wang, Luke Zettlemoyer, Noah A. Smith


  Access Paper or Ask Questions

UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models


Jan 20, 2022
Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I. Wang, Victor Zhong, Bailin Wang, Chengzu Li, Connor Boyle, Ansong Ni, Ziyu Yao, Dragomir Radev, Caiming Xiong, Lingpeng Kong, Rui Zhang, Noah A. Smith, Luke Zettlemoyer, Tao Yu


  Access Paper or Ask Questions

WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation


Jan 16, 2022
Alisa Liu, Swabha Swayamdipta, Noah A. Smith, Yejin Choi

* preprint 

  Access Paper or Ask Questions

Computational Lens on Cognition: Study Of Autobiographical Versus Imagined Stories With Large-Scale Language Models


Jan 07, 2022
Maarten Sap, Anna Jafarpour, Yejin Choi, Noah A. Smith, James W. Pennebaker, Eric Horvitz

* Equal contribution from Sap and Jafarpour; in review 

  Access Paper or Ask Questions

NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics


Dec 16, 2021
Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, Yejin Choi


  Access Paper or Ask Questions

Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand


Dec 08, 2021
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, Noah A. Smith

* Project website: https://nlp.cs.washington.edu/billboard/ 

  Access Paper or Ask Questions

Transparent Human Evaluation for Image Captioning


Nov 17, 2021
Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, Noah A. Smith


  Access Paper or Ask Questions

Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection


Nov 15, 2021
Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, Noah A. Smith


  Access Paper or Ask Questions

Time Waits for No One! Analysis and Challenges of Temporal Misalignment


Nov 14, 2021
Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, Noah A. Smith

* 9 pages, 6 figures, 3 tables 

  Access Paper or Ask Questions

ABC: Attention with Bounded-memory Control


Oct 06, 2021
Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith


  Access Paper or Ask Questions

Expected Validation Performance and Estimation of a Random Variable's Maximum


Oct 01, 2021
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith


  Access Paper or Ask Questions

Sentence Bottleneck Autoencoders from Transformer Language Models


Aug 31, 2021
Ivan Montero, Nikolaos Pappas, Noah A. Smith


  Access Paper or Ask Questions

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation


Aug 27, 2021
Ofir Press, Noah A. Smith, Mike Lewis


  Access Paper or Ask Questions

DEMix Layers: Disentangling Domains for Modular Language Modeling


Aug 20, 2021
Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer

* edits: updated reference links, added related work, typo fixes 

  Access Paper or Ask Questions

All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text


Jul 07, 2021
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith

* references added, corrected typo 

  Access Paper or Ask Questions

Scarecrow: A Framework for Scrutinizing Machine Text


Jul 06, 2021
Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A. Smith, Yejin Choi

* The project webpage is at https://yao-dou.github.io/scarecrow/ 

  Access Paper or Ask Questions

On the Power of Saturated Transformers: A View from Circuit Complexity


Jun 30, 2021
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

* Preprint 

  Access Paper or Ask Questions

Specializing Multilingual Language Models: An Empirical Study


Jun 22, 2021
Ethan C. Chau, Noah A. Smith

* Work in progress 

  Access Paper or Ask Questions

Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study


Jun 17, 2021
Rahul Nadkarni, David Wadden, Iz Beltagy, Noah A. Smith, Hannaneh Hajishirzi, Tom Hope


  Access Paper or Ask Questions

DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts


Jun 03, 2021
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi

* ACL 2021 camera-ready 

  Access Paper or Ask Questions

On-the-Fly Controlled Text Generation with Experts and Anti-Experts


May 07, 2021
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi

* Accepted to ACL 2021, camera-ready version coming soon 

  Access Paper or Ask Questions

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers


May 07, 2021
Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, Matt Gardner

* Accepted at NAACL 2021; Project page: https://allenai.org/project/qasper 

  Access Paper or Ask Questions

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?


Apr 22, 2021
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

* Accepted at TACL; pre-MIT Press publication version 

  Access Paper or Ask Questions

Go Forth and Prosper: Language Modeling with Ancient Textual History


Apr 18, 2021
Rik Koncel-Kedziorski, Noah A. Smith


  Access Paper or Ask Questions

Probing Across Time: What Does RoBERTa Know and When?


Apr 16, 2021
Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith


  Access Paper or Ask Questions