Conversational information seeking
Conversational information seeking (CIS) is concerned with a sequence of interactions
between one or more users and an information system. Interactions in CIS are primarily …
between one or more users and an information system. Interactions in CIS are primarily …
Report from the nsf future directions workshop on automatic evaluation of dialog: Research directions and challenges
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog.
The workshop explored the current state of the art along with its limitations and suggested …
The workshop explored the current state of the art along with its limitations and suggested …
Prosocialdialog: A prosocial backbone for conversational agents
Most existing dialogue systems fail to respond properly to potentially unsafe user utterances
by either ignoring or passively agreeing with them. To address this issue, we introduce …
by either ignoring or passively agreeing with them. To address this issue, we introduce …
Human evaluation of conversations is an open problem: comparing the sensitivity of various methods for evaluating dialogue agents
At the heart of improving conversational AI is the open problem of how to evaluate
conversations. Issues with automatic metrics are well known (Liu et al., 2016, arxiv …
conversations. Issues with automatic metrics are well known (Liu et al., 2016, arxiv …
The AI doctor is in: A survey of task-oriented dialogue systems for healthcare applications
M Valizadeh, N Parde - Proceedings of the 60th Annual Meeting …, 2022 - aclanthology.org
Task-oriented dialogue systems are increasingly prevalent in healthcare settings, and have
been characterized by a diverse range of architectures and objectives. Although these …
been characterized by a diverse range of architectures and objectives. Although these …
DynaEval: Unifying turn and dialogue level evaluation
A dialogue is essentially a multi-turn interaction among interlocutors. Effective evaluation
metrics should reflect the dynamics of such interaction. Existing automatic metrics are …
metrics should reflect the dynamics of such interaction. Existing automatic metrics are …
Evaluating conversational recommender systems: A landscape of research
D Jannach - Artificial Intelligence Review, 2023 - Springer
Conversational recommender systems aim to interactively support online users in their
information search and decision-making processes in an intuitive way. With the latest …
information search and decision-making processes in an intuitive way. With the latest …
Achieving reliable human assessment of open-domain dialogue systems
Evaluation of open-domain dialogue systems is highly challenging and development of
better techniques is highlighted time and again as desperately needed. Despite substantial …
better techniques is highlighted time and again as desperately needed. Despite substantial …
Building a role specified open-domain dialogue system leveraging large-scale language models
Recent open-domain dialogue models have brought numerous breakthroughs. However,
building a chat system is not scalable since it often requires a considerable volume of …
building a chat system is not scalable since it often requires a considerable volume of …
Understanding and predicting user satisfaction with conversational recommender systems
User satisfaction depicts the effectiveness of a system from the user's perspective.
Understanding and predicting user satisfaction is vital for the design of user-oriented …
Understanding and predicting user satisfaction is vital for the design of user-oriented …