Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Noah A. Smith

Noah A. Smith

University of Washington, Allen Institute for Artificial Intelligence

All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text


Jul 07, 2021
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith

Figure 1 for All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
Figure 2 for All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
Figure 3 for All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
Figure 4 for All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
* references added, corrected typo 
  Access Paper or Ask Questions

Scarecrow: A Framework for Scrutinizing Machine Text


Jul 06, 2021
Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A. Smith, Yejin Choi

Figure 1 for Scarecrow: A Framework for Scrutinizing Machine Text
Figure 2 for Scarecrow: A Framework for Scrutinizing Machine Text
Figure 3 for Scarecrow: A Framework for Scrutinizing Machine Text
Figure 4 for Scarecrow: A Framework for Scrutinizing Machine Text
* The project webpage is at https://yao-dou.github.io/scarecrow/ 
  Access Paper or Ask Questions

On the Power of Saturated Transformers: A View from Circuit Complexity


Jun 30, 2021
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Figure 1 for On the Power of Saturated Transformers: A View from Circuit Complexity
Figure 2 for On the Power of Saturated Transformers: A View from Circuit Complexity
Figure 3 for On the Power of Saturated Transformers: A View from Circuit Complexity
Figure 4 for On the Power of Saturated Transformers: A View from Circuit Complexity
* Preprint 
  Access Paper or Ask Questions

Specializing Multilingual Language Models: An Empirical Study


Jun 22, 2021
Ethan C. Chau, Noah A. Smith

Figure 1 for Specializing Multilingual Language Models: An Empirical Study
Figure 2 for Specializing Multilingual Language Models: An Empirical Study
Figure 3 for Specializing Multilingual Language Models: An Empirical Study
Figure 4 for Specializing Multilingual Language Models: An Empirical Study
* Work in progress 
  Access Paper or Ask Questions

Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study


Jun 17, 2021
Rahul Nadkarni, David Wadden, Iz Beltagy, Noah A. Smith, Hannaneh Hajishirzi, Tom Hope

Figure 1 for Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study
Figure 2 for Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study
Figure 3 for Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study
Figure 4 for Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study

  Access Paper or Ask Questions

DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts


Jun 03, 2021
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi

Figure 1 for DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
Figure 2 for DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
Figure 3 for DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
Figure 4 for DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
* ACL 2021 camera-ready 
  Access Paper or Ask Questions

On-the-Fly Controlled Text Generation with Experts and Anti-Experts


May 07, 2021
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi

Figure 1 for On-the-Fly Controlled Text Generation with Experts and Anti-Experts
Figure 2 for On-the-Fly Controlled Text Generation with Experts and Anti-Experts
Figure 3 for On-the-Fly Controlled Text Generation with Experts and Anti-Experts
Figure 4 for On-the-Fly Controlled Text Generation with Experts and Anti-Experts
* Accepted to ACL 2021, camera-ready version coming soon 
  Access Paper or Ask Questions

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers


May 07, 2021
Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, Matt Gardner

Figure 1 for A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
Figure 2 for A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
Figure 3 for A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
Figure 4 for A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
* Accepted at NAACL 2021; Project page: https://allenai.org/project/qasper 
  Access Paper or Ask Questions

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?


Apr 22, 2021
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Figure 1 for Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?
Figure 2 for Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?
Figure 3 for Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?
Figure 4 for Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?
* Accepted at TACL; pre-MIT Press publication version 
  Access Paper or Ask Questions

Go Forth and Prosper: Language Modeling with Ancient Textual History


Apr 18, 2021
Rik Koncel-Kedziorski, Noah A. Smith

Figure 1 for Go Forth and Prosper: Language Modeling with Ancient Textual History
Figure 2 for Go Forth and Prosper: Language Modeling with Ancient Textual History

  Access Paper or Ask Questions

Probing Across Time: What Does RoBERTa Know and When?


Apr 16, 2021
Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith

Figure 1 for Probing Across Time: What Does RoBERTa Know and When?
Figure 2 for Probing Across Time: What Does RoBERTa Know and When?
Figure 3 for Probing Across Time: What Does RoBERTa Know and When?
Figure 4 for Probing Across Time: What Does RoBERTa Know and When?

  Access Paper or Ask Questions

Finetuning Pretrained Transformers into RNNs


Mar 24, 2021
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith

Figure 1 for Finetuning Pretrained Transformers into RNNs
Figure 2 for Finetuning Pretrained Transformers into RNNs
Figure 3 for Finetuning Pretrained Transformers into RNNs
Figure 4 for Finetuning Pretrained Transformers into RNNs

  Access Paper or Ask Questions

Random Feature Attention


Mar 19, 2021
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong

Figure 1 for Random Feature Attention
Figure 2 for Random Feature Attention
Figure 3 for Random Feature Attention
Figure 4 for Random Feature Attention
* ICLR 2021 
  Access Paper or Ask Questions

Challenges in Automated Debiasing for Toxic Language Detection


Jan 29, 2021
Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Noah A. Smith, Yejin Choi

Figure 1 for Challenges in Automated Debiasing for Toxic Language Detection
Figure 2 for Challenges in Automated Debiasing for Toxic Language Detection
Figure 3 for Challenges in Automated Debiasing for Toxic Language Detection
Figure 4 for Challenges in Automated Debiasing for Toxic Language Detection
* EACL 2021 
  Access Paper or Ask Questions

GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation


Jan 17, 2021
Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, Daniel S. Weld

Figure 1 for GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Figure 2 for GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Figure 3 for GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Figure 4 for GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation

  Access Paper or Ask Questions

Shortformer: Better Language Modeling using Shorter Inputs


Dec 31, 2020
Ofir Press, Noah A. Smith, Mike Lewis

Figure 1 for Shortformer: Better Language Modeling using Shorter Inputs
Figure 2 for Shortformer: Better Language Modeling using Shorter Inputs
Figure 3 for Shortformer: Better Language Modeling using Shorter Inputs
Figure 4 for Shortformer: Better Language Modeling using Shorter Inputs

  Access Paper or Ask Questions

Infusing Finetuning with Semantic Dependencies


Dec 20, 2020
Zhaofeng Wu, Hao Peng, Noah A. Smith

Figure 1 for Infusing Finetuning with Semantic Dependencies
Figure 2 for Infusing Finetuning with Semantic Dependencies
Figure 3 for Infusing Finetuning with Semantic Dependencies
Figure 4 for Infusing Finetuning with Semantic Dependencies
* Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2020. Author's final version (pre-MIT Press publication) 
  Access Paper or Ask Questions

Measuring Association Between Labels and Free-Text Rationales


Oct 24, 2020
Sarah Wiegreffe, Ana Marasovic, Noah A. Smith

Figure 1 for Measuring Association Between Labels and Free-Text Rationales
Figure 2 for Measuring Association Between Labels and Free-Text Rationales
Figure 3 for Measuring Association Between Labels and Free-Text Rationales
Figure 4 for Measuring Association Between Labels and Free-Text Rationales

  Access Paper or Ask Questions

Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings


Oct 15, 2020
Phillip Keung, Julian Salazar, Yichao Lu, Noah A. Smith

Figure 1 for Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings
Figure 2 for Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings
Figure 3 for Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings
Figure 4 for Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings
* To appear in the Transactions of the Association for Computational Linguistics 
  Access Paper or Ask Questions

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics


Oct 15, 2020
Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, Yejin Choi

Figure 1 for Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
Figure 2 for Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
Figure 3 for Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
Figure 4 for Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
* Proceedings of EMNLP 2020 
  Access Paper or Ask Questions

Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs


Oct 15, 2020
Ana Marasović, Chandra Bhagavatula, Jae Sung Park, Ronan Le Bras, Noah A. Smith, Yejin Choi

Figure 1 for Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs
Figure 2 for Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs
Figure 3 for Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs
Figure 4 for Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs
* Accepted to Findings of EMNLP 
  Access Paper or Ask Questions

Plug and Play Autoencoders for Conditional Text Generation


Oct 12, 2020
Florian Mai, Nikolaos Pappas, Ivan Montero, Noah A. Smith, James Henderson

Figure 1 for Plug and Play Autoencoders for Conditional Text Generation
Figure 2 for Plug and Play Autoencoders for Conditional Text Generation
Figure 3 for Plug and Play Autoencoders for Conditional Text Generation
Figure 4 for Plug and Play Autoencoders for Conditional Text Generation
* To be published in EMNLP 2020 
  Access Paper or Ask Questions

The Multilingual Amazon Reviews Corpus


Oct 06, 2020
Phillip Keung, Yichao Lu, György Szarvas, Noah A. Smith

Figure 1 for The Multilingual Amazon Reviews Corpus
Figure 2 for The Multilingual Amazon Reviews Corpus
Figure 3 for The Multilingual Amazon Reviews Corpus
Figure 4 for The Multilingual Amazon Reviews Corpus
* To appear in EMNLP 2020 
  Access Paper or Ask Questions

Grounded Compositional Outputs for Adaptive Language Modeling


Oct 05, 2020
Nikolaos Pappas, Phoebe Mulcaire, Noah A. Smith

Figure 1 for Grounded Compositional Outputs for Adaptive Language Modeling
Figure 2 for Grounded Compositional Outputs for Adaptive Language Modeling
Figure 3 for Grounded Compositional Outputs for Adaptive Language Modeling
Figure 4 for Grounded Compositional Outputs for Adaptive Language Modeling
* EMNLP 2020 
  Access Paper or Ask Questions

Multilevel Text Alignment with Cross-Document Attention


Oct 03, 2020
Xuhui Zhou, Nikolaos Pappas, Noah A. Smith

Figure 1 for Multilevel Text Alignment with Cross-Document Attention
Figure 2 for Multilevel Text Alignment with Cross-Document Attention
Figure 3 for Multilevel Text Alignment with Cross-Document Attention
Figure 4 for Multilevel Text Alignment with Cross-Document Attention
* EMNLP 2020 
  Access Paper or Ask Questions