Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Anastasia Shimorina

A Systematic Review of Reproducibility Research in Natural Language Processing


Mar 21, 2021
Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter

* To be published in proceedings of EACL'21 

  Access Paper or Ask Questions

The Human Evaluation Datasheet 1.0: A Template for Recording Details of Human Evaluation Experiments in NLP


Mar 17, 2021
Anastasia Shimorina, Anya Belz

* Unpublished manuscript 

  Access Paper or Ask Questions

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics


Feb 03, 2021
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondřej Dušek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou


  Access Paper or Ask Questions

Human vs Automatic Metrics: on the Importance of Correlation Design


May 30, 2018
Anastasia Shimorina

* accepted for the WiNLP workshop at NAACL 2018; 3 pages 

  Access Paper or Ask Questions

Split and Rephrase


Jul 21, 2017
Shashi Narayan, Claire Gardent, Shay B. Cohen, Anastasia Shimorina

* 11 pages, EMNLP 2017 

  Access Paper or Ask Questions