Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?


Apr 12, 2022
Thomas Wang , Adam Roberts , Daniel Hesslow , Teven Le Scao , Hyung Won Chung , Iz Beltagy , Julien Launay , Colin Raffel


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search


Mar 16, 2022
Daniel King , Zejiang Shen , Nishant Subramani , Daniel S. Weld , Iz Beltagy , Doug Downey

* 16 pages, 2 figures, 7 tables 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Staged Training for Transformer Language Models


Mar 11, 2022
Sheng Shen , Pete Walsh , Kurt Keutzer , Jesse Dodge , Matthew Peters , Iz Beltagy


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

LongChecker: Improving scientific claim verification by modeling full-abstract context


Dec 02, 2021
David Wadden , Kyle Lo , Lucy Lu Wang , Arman Cohan , Iz Beltagy , Hannaneh Hajishirzi

* Preprint - work in progress. 9 pages 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Few-Shot Self-Rationalization with Natural Language Prompts


Nov 16, 2021
Ana Marasović , Iz Beltagy , Doug Downey , Matthew E. Peters

* First two authors contributed equally 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

PRIMER: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization


Oct 16, 2021
Wen Xiao , Iz Beltagy , Giuseppe Carenini , Arman Cohan


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

FLEX: Unifying Evaluation for Few-Shot NLP


Jul 15, 2021
Jonathan Bragg , Arman Cohan , Kyle Lo , Iz Beltagy

* First two authors contributed equally. Code and leaderboard available at: https://github.com/allenai/flex 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study


Jun 17, 2021
Rahul Nadkarni , David Wadden , Iz Beltagy , Noah A. Smith , Hannaneh Hajishirzi , Tom Hope


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers


May 07, 2021
Pradeep Dasigi , Kyle Lo , Iz Beltagy , Arman Cohan , Noah A. Smith , Matt Gardner

* Accepted at NAACL 2021; Project page: https://allenai.org/project/qasper 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts


Apr 18, 2021
Arie Cattan , Sophie Johnson , Daniel Weld , Ido Dagan , Iz Beltagy , Doug Downey , Tom Hope

* Data and code available at https://github.com/ariecattan/SciCo 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email
1
2
3
>>