Alert button
Picture for Daniel Deutsch

Daniel Deutsch

Alert button

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code

Jun 23, 2022
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina McMillan-Major, Anna Shvets, Ashish Upadhyay, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh Dhole, Khyathi Raghavi Chandu, Laura Perez-Beltrachini, Leonardo F. R. Ribeiro, Lewis Tunstall, Li Zhang, Mahima Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Štajner, Sebastien Montella, Shailza, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin Adewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou

Figure 1 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Figure 2 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Figure 3 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Figure 4 for GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Viaarxiv icon

Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code

Apr 29, 2022
Daniel Deutsch, Dan Roth

Figure 1 for Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code
Viaarxiv icon

Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics

Apr 21, 2022
Daniel Deutsch, Rotem Dror, Dan Roth

Figure 1 for Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Figure 2 for Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Figure 3 for Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Figure 4 for Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Viaarxiv icon

Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics

Apr 21, 2022
Daniel Deutsch, Dan Roth

Figure 1 for Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics
Figure 2 for Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics
Figure 3 for Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics
Figure 4 for Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics
Viaarxiv icon

Question-Based Salient Span Selection for More Controllable Text Summarization

Nov 15, 2021
Daniel Deutsch, Dan Roth

Figure 1 for Question-Based Salient Span Selection for More Controllable Text Summarization
Figure 2 for Question-Based Salient Span Selection for More Controllable Text Summarization
Figure 3 for Question-Based Salient Span Selection for More Controllable Text Summarization
Figure 4 for Question-Based Salient Span Selection for More Controllable Text Summarization
Viaarxiv icon

A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods

Mar 31, 2021
Daniel Deutsch, Rotem Dror, Dan Roth

Figure 1 for A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods
Figure 2 for A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods
Figure 3 for A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods
Figure 4 for A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods
Viaarxiv icon

Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries

Oct 23, 2020
Daniel Deutsch, Dan Roth

Figure 1 for Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries
Figure 2 for Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries
Figure 3 for Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries
Figure 4 for Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries
Viaarxiv icon

Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary

Oct 01, 2020
Daniel Deutsch, Tania Bedrax-Weiss, Dan Roth

Figure 1 for Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Figure 2 for Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Figure 3 for Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Figure 4 for Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Viaarxiv icon

SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics

Jul 10, 2020
Daniel Deutsch, Dan Roth

Viaarxiv icon