User simulation for evaluating information access systems

K Balog, CX Zhai - Proceedings of the Annual International ACM SIGIR …, 2023 - dl.acm.org
With the emergence of various information access systems exhibiting increasing complexity,
there is a critical need for sound and scalable means of automatic evaluation. To address …

Evaluating Conversational Recommender Systems with Large Language Models: A User-Centric Evaluation Framework

N Chen, Q Dai, X Dong, XM Wu, Z Dong - arxiv preprint arxiv:2501.09493, 2025 - arxiv.org
Conversational recommender systems (CRS) involve both recommendation and dialogue
tasks, which makes their evaluation a unique challenge. Although past research has …

Vague Preference Policy Learning for Conversational Recommendation

G Zhang, C Gao, W Lei, X Guo, S Li, H Chen… - arxiv preprint arxiv …, 2023 - arxiv.org
Conversational recommendation systems (CRS) commonly assume users have clear
preferences, leading to potential over-filtering of relevant alternatives. However, users often …

Towards Conversational Recommendation in Education: Synthesizing Conversations from Structured Course Data and Benchmarking for Conversational Curriculum …

E Steira - 2024 - ntnuopen.ntnu.no
Conversational Recommender Systems (CRS) introduce a conversational element to
traditional Recommender Systems (RS), allowing for dynamic and interactive …