Get our free extension to see links to code for papers anywhere online!

Chrome logo  Add to Chrome

Firefox logo Add to Firefox

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code


Jun 24, 2022
Sebastian Gehrmann , Abhik Bhattacharjee , Abinaya Mahendiran , Alex Wang , Alexandros Papangelis , Aman Madaan , Angelina McMillan-Major , Anna Shvets , Ashish Upadhyay , Bingsheng Yao , Bryan Wilie , Chandra Bhagavatula , Chaobin You , Craig Thomson , Cristina Garbacea , Dakuo Wang , Daniel Deutsch , Deyi Xiong , Di Jin , Dimitra Gkatzia , Dragomir Radev , Elizabeth Clark , Esin Durmus , Faisal Ladhak , Filip Ginter , Genta Indra Winata , Hendrik Strobelt , Hiroaki Hayashi , Jekaterina Novikova , Jenna Kanerva , Jenny Chim , Jiawei Zhou , Jordan Clive , Joshua Maynez , João Sedoc , Juraj Juraska , Kaustubh Dhole , Khyathi Raghavi Chandu , Laura Perez-Beltrachini , Leonardo F. R. Ribeiro , Lewis Tunstall , Li Zhang , Mahima Pushkarna , Mathias Creutz , Michael White , Mihir Sanjay Kale , Moussa Kamal Eddine , Nico Daheim , Nishant Subramani , Ondrej Dusek , Paul Pu Liang , Pawan Sasanka Ammanamanchi , Qi Zhu , Ratish Puduppully , Reno Kriz , Rifat Shahriyar , Ronald Cardenas , Saad Mahamood , Salomey Osei , Samuel Cahyawijaya , Sanja Štajner , Sebastien Montella , Shailza , Shailza Jolly , Simon Mille , Tahmid Hasan , Tianhao Shen , Tosin Adewumi , Vikas Raunak , Vipul Raheja , Vitaly Nikolaev , Vivian Tsai , Yacine Jernite , Ying Xu , Yisi Sang , Yixin Liu , Yufang Hou


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Measuring Attribution in Natural Language Generation Models


Dec 23, 2021
Hannah Rashkin , Vitaly Nikolaev , Matthew Lamm , Michael Collins , Dipanjan Das , Slav Petrov , Gaurav Singh Tomar , Iulia Turc , David Reitter


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets


Nov 11, 2021
Ann Yuan , Daphne Ippolito , Vitaly Nikolaev , Chris Callison-Burch , Andy Coenen , Sebastian Gehrmann

* 10 pages, 2 figures, accepted to NeurIPS 2021 Datasets and Benchmarks Track 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics


Feb 03, 2021
Sebastian Gehrmann , Tosin Adewumi , Karmanya Aggarwal , Pawan Sasanka Ammanamanchi , Aremu Anuoluwapo , Antoine Bosselut , Khyathi Raghavi Chandu , Miruna Clinciu , Dipanjan Das , Kaustubh D. Dhole , Wanyu Du , Esin Durmus , Ondřej Dušek , Chris Emezue , Varun Gangal , Cristina Garbacea , Tatsunori Hashimoto , Yufang Hou , Yacine Jernite , Harsh Jhamtani , Yangfeng Ji , Shailza Jolly , Dhruv Kumar , Faisal Ladhak , Aman Madaan , Mounica Maddela , Khyati Mahajan , Saad Mahamood , Bodhisattwa Prasad Majumder , Pedro Henrique Martins , Angelina McMillan-Major , Simon Mille , Emiel van Miltenburg , Moin Nadeem , Shashi Narayan , Vitaly Nikolaev , Rubungo Andre Niyongabo , Salomey Osei , Ankur Parikh , Laura Perez-Beltrachini , Niranjan Ramesh Rao , Vikas Raunak , Juan Diego Rodriguez , Sashank Santhanam , João Sedoc , Thibault Sellam , Samira Shaikh , Anastasia Shimorina , Marco Antonio Sobrevilla Cabezudo , Hendrik Strobelt , Nishant Subramani , Wei Xu , Diyi Yang , Akhila Yerukola , Jiawei Zhou


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images


Nov 01, 2020
Vitaly Nikolaev


   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email

TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages


Mar 10, 2020
Jonathan H. Clark , Eunsol Choi , Michael Collins , Dan Garrette , Tom Kwiatkowski , Vitaly Nikolaev , Jennimaria Palomaki

* To appear in Transactions of the Association for Computational Linguistics (TACL) 2020. Please use this as the citation 

   Access Paper or Ask Questions

  • Share via Twitter
  • Share via Facebook
  • Share via LinkedIn
  • Share via Whatsapp
  • Share via Messenger
  • Share via Email