Alert button

Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

Sep 13, 2021
Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, Mikhail Burtsev

Figure 1 for Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions
Figure 2 for Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions
Figure 3 for Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions
Figure 4 for Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

Share this with someone who'll enjoy it:

Enabling open-domain dialogue systems to ask clarifying questions when appropriate is an important direction for improving the quality of the system response. Namely, for cases when a user request is not specific enough for a conversation system to provide an answer right away, it is desirable to ask a clarifying question to increase the chances of retrieving a satisfying answer. To address the problem of 'asking clarifying questions in open-domain dialogues': (1) we collect and release a new dataset focused on open-domain single- and multi-turn conversations, (2) we benchmark several state-of-the-art neural baselines, and (3) we propose a pipeline consisting of offline and online steps for evaluating the quality of clarifying questions in various dialogues. These contributions are suitable as a foundation for further research.

* Accepted in EMNLP 2021  
View paper onarxiv icon

Share this with someone who'll enjoy it: