Get our free extension to see links to code for papers anywhere online!

Add to Chrome

Add to Firefox

Picture for Vitaly Nikolaev

Vitaly Nikolaev

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Jun 24, 2022
Sebastian Gehrmann , Abhik Bhattacharjee , Abinaya Mahendiran , Alex Wang , Alexandros Papangelis , Aman Madaan , Angelina McMillan-Major , Anna Shvets , Ashish Upadhyay , Bingsheng Yao , Bryan Wilie , Chandra Bhagavatula , Chaobin You , Craig Thomson , Cristina Garbacea , Dakuo Wang , Daniel Deutsch , Deyi Xiong , Di Jin , Dimitra Gkatzia , Dragomir Radev , Elizabeth Clark , Esin Durmus , Faisal Ladhak , Filip Ginter , Genta Indra Winata , Hendrik Strobelt , Hiroaki Hayashi , Jekaterina Novikova , Jenna Kanerva , Jenny Chim , Jiawei Zhou , Jordan Clive , Joshua Maynez , João Sedoc , Juraj Juraska , Kaustubh Dhole , Khyathi Raghavi Chandu , Laura Perez-Beltrachini , Leonardo F. R. Ribeiro , Lewis Tunstall , Li Zhang , Mahima Pushkarna , Mathias Creutz , Michael White , Mihir Sanjay Kale , Moussa Kamal Eddine , Nico Daheim , Nishant Subramani , Ondrej Dusek , Paul Pu Liang , Pawan Sasanka Ammanamanchi , Qi Zhu , Ratish Puduppully , Reno Kriz , Rifat Shahriyar , Ronald Cardenas , Saad Mahamood , Salomey Osei , Samuel Cahyawijaya , Sanja Štajner , Sebastien Montella , Shailza , Shailza Jolly , Simon Mille , Tahmid Hasan , Tianhao Shen , Tosin Adewumi , Vikas Raunak , Vipul Raheja , Vitaly Nikolaev , Vivian Tsai , Yacine Jernite , Ying Xu , Yisi Sang , Yixin Liu , Yufang Hou

Figure 1 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Figure 2 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Figure 3 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Figure 4 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Access Paper or Ask Questions

SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets

Nov 11, 2021
Ann Yuan , Daphne Ippolito , Vitaly Nikolaev , Chris Callison-Burch , Andy Coenen , Sebastian Gehrmann

Figure 1 for SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets

Figure 2 for SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets

Figure 3 for SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets

Figure 4 for SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets

* 10 pages, 2 figures, accepted to NeurIPS 2021 Datasets and Benchmarks Track

Access Paper or Ask Questions

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Feb 03, 2021
Sebastian Gehrmann , Tosin Adewumi , Karmanya Aggarwal , Pawan Sasanka Ammanamanchi , Aremu Anuoluwapo , Antoine Bosselut , Khyathi Raghavi Chandu , Miruna Clinciu , Dipanjan Das , Kaustubh D. Dhole , Wanyu Du , Esin Durmus , Ondřej Dušek , Chris Emezue , Varun Gangal , Cristina Garbacea , Tatsunori Hashimoto , Yufang Hou , Yacine Jernite , Harsh Jhamtani , Yangfeng Ji , Shailza Jolly , Dhruv Kumar , Faisal Ladhak , Aman Madaan , Mounica Maddela , Khyati Mahajan , Saad Mahamood , Bodhisattwa Prasad Majumder , Pedro Henrique Martins , Angelina McMillan-Major , Simon Mille , Emiel van Miltenburg , Moin Nadeem , Shashi Narayan , Vitaly Nikolaev , Rubungo Andre Niyongabo , Salomey Osei , Ankur Parikh , Laura Perez-Beltrachini , Niranjan Ramesh Rao , Vikas Raunak , Juan Diego Rodriguez , Sashank Santhanam , João Sedoc , Thibault Sellam , Samira Shaikh , Anastasia Shimorina , Marco Antonio Sobrevilla Cabezudo , Hendrik Strobelt , Nishant Subramani , Wei Xu , Diyi Yang , Akhila Yerukola , Jiawei Zhou

Figure 1 for The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Figure 2 for The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Figure 3 for The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Figure 4 for The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Access Paper or Ask Questions

Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images

Nov 01, 2020
Vitaly Nikolaev

Figure 1 for Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images

Figure 2 for Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images

Figure 3 for Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images

Figure 4 for Convolution Neural Networks for Semantic Segmentation: Application to Small Datasets of Biomedical Images

Access Paper or Ask Questions

TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

Mar 10, 2020
Jonathan H. Clark , Eunsol Choi , Michael Collins , Dan Garrette , Tom Kwiatkowski , Vitaly Nikolaev , Jennimaria Palomaki

Figure 1 for TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

Figure 2 for TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

Figure 3 for TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

Figure 4 for TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

* To appear in Transactions of the Association for Computational Linguistics (TACL) 2020. Please use this as the citation

Access Paper or Ask Questions