Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Noah A. Smith

Noah A. Smith

University of Washington, Allen Institute for Artificial Intelligence

On-the-Fly Controlled Text Generation with Experts and Anti-Experts


May 07, 2021
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi

* Accepted to ACL 2021, camera-ready version coming soon 

  Access Paper or Ask Questions

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers


May 07, 2021
Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, Matt Gardner

* Accepted at NAACL 2021; Project page: https://allenai.org/project/qasper 

  Access Paper or Ask Questions

Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?


Apr 22, 2021
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

* Accepted at TACL; pre-MIT Press publication version 

  Access Paper or Ask Questions

Go Forth and Prosper: Language Modeling with Ancient Textual History


Apr 18, 2021
Rik Koncel-Kedziorski, Noah A. Smith


  Access Paper or Ask Questions

Probing Across Time: What Does RoBERTa Know and When?


Apr 16, 2021
Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith


  Access Paper or Ask Questions

Finetuning Pretrained Transformers into RNNs


Mar 24, 2021
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith


  Access Paper or Ask Questions

Random Feature Attention


Mar 19, 2021
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong

* ICLR 2021 

  Access Paper or Ask Questions

Challenges in Automated Debiasing for Toxic Language Detection


Jan 29, 2021
Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Noah A. Smith, Yejin Choi

* EACL 2021 

  Access Paper or Ask Questions

GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation


Jan 17, 2021
Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, Daniel S. Weld


  Access Paper or Ask Questions

Shortformer: Better Language Modeling using Shorter Inputs


Dec 31, 2020
Ofir Press, Noah A. Smith, Mike Lewis


  Access Paper or Ask Questions

Infusing Finetuning with Semantic Dependencies


Dec 20, 2020
Zhaofeng Wu, Hao Peng, Noah A. Smith

* Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2020. Author's final version (pre-MIT Press publication) 

  Access Paper or Ask Questions

Measuring Association Between Labels and Free-Text Rationales


Oct 24, 2020
Sarah Wiegreffe, Ana Marasovic, Noah A. Smith


  Access Paper or Ask Questions

Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings


Oct 15, 2020
Phillip Keung, Julian Salazar, Yichao Lu, Noah A. Smith

* To appear in the Transactions of the Association for Computational Linguistics 

  Access Paper or Ask Questions

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics


Oct 15, 2020
Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, Yejin Choi

* Proceedings of EMNLP 2020 

  Access Paper or Ask Questions

Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs


Oct 15, 2020
Ana Marasović, Chandra Bhagavatula, Jae Sung Park, Ronan Le Bras, Noah A. Smith, Yejin Choi

* Accepted to Findings of EMNLP 

  Access Paper or Ask Questions

Plug and Play Autoencoders for Conditional Text Generation


Oct 12, 2020
Florian Mai, Nikolaos Pappas, Ivan Montero, Noah A. Smith, James Henderson

* To be published in EMNLP 2020 

  Access Paper or Ask Questions

The Multilingual Amazon Reviews Corpus


Oct 06, 2020
Phillip Keung, Yichao Lu, György Szarvas, Noah A. Smith

* To appear in EMNLP 2020 

  Access Paper or Ask Questions

Grounded Compositional Outputs for Adaptive Language Modeling


Oct 05, 2020
Nikolaos Pappas, Phoebe Mulcaire, Noah A. Smith

* EMNLP 2020 

  Access Paper or Ask Questions

Multilevel Text Alignment with Cross-Document Attention


Oct 03, 2020
Xuhui Zhou, Nikolaos Pappas, Noah A. Smith

* EMNLP 2020 

  Access Paper or Ask Questions

Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank


Sep 29, 2020
Ethan C. Chau, Lucy H. Lin, Noah A. Smith

* Accepted to Findings of EMNLP 2020 

  Access Paper or Ask Questions

RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models


Sep 25, 2020
Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, Noah A. Smith

* Findings in EMNLP 2020 

  Access Paper or Ask Questions

Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation


Jun 28, 2020
Jungo Kasai, Nikolaos Pappas, Hao Peng, James Cross, Noah A. Smith

* Added references and acknowledgements 

  Access Paper or Ask Questions

A Mixture of $h-1$ Heads is Better than $h$ Heads


May 13, 2020
Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith

* ACL2020 

  Access Paper or Ask Questions

The Right Tool for the Job: Matching Model and Instance Complexities


May 09, 2020
Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah A. Smith

* ACL 2020; 12 pages; code available in https://github.com/allenai/sledgehammer 

  Access Paper or Ask Questions

Don't Stop Pretraining: Adapt Language Models to Domains and Tasks


May 05, 2020
Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith

* ACL 2020 

  Access Paper or Ask Questions