User simulation for evaluating information access systems

K Balog, CX Zhai - Proceedings of the Annual International ACM SIGIR …, 2023 - dl.acm.org
With the emergence of various information access systems exhibiting increasing complexity,
there is a critical need for sound and scalable means of automatic evaluation. To address …

Diverse and effective synthetic data generation for adaptable zero-shot dialogue state tracking

JD Finch, JD Choi - arxiv preprint arxiv:2405.12468, 2024 - arxiv.org
We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by
enhancing training data diversity through synthetic data generation. Existing DST datasets …

Instilling type knowledge in language models via multi-task QA

S Li, M Sridhar, CS Prakash, J Cao, W Hamza… - arxiv preprint arxiv …, 2022 - arxiv.org
Understanding human language often necessitates understanding entities and their place in
a taxonomy of knowledge--their types. Previous methods to learn entity types rely on training …