Usimagent: Large language models for simulating search users
Due to the advantages in the cost-efficiency and reproducibility, user simulation has become
a promising solution to the user-centric evaluation of information retrieval systems …
a promising solution to the user-centric evaluation of information retrieval systems …
Users meet clarifying questions: Toward a better understanding of user interactions for search clarification
The use of clarifying questions (CQs) is a fairly new and useful technique to aid systems in
recognizing the intent, context, and preferences behind user queries. Yet, understanding the …
recognizing the intent, context, and preferences behind user queries. Yet, understanding the …
Investigating reference dependence effects on user search interaction and satisfaction: A behavioral economics perspective
J Liu, F Han - Proceedings of the 43rd international ACM SIGIR …, 2020 - dl.acm.org
How users think, behave, and make decisions when interacting with information retrieval
(IR) systems is a fundamental research problem in the area of Interactive IR. There is …
(IR) systems is a fundamental research problem in the area of Interactive IR. There is …
Constructing better evaluation metrics by incorporating the anchoring effect into the user model
Models of existing evaluation metrics assume that users are rational decision-makers trying
to pursue maximised utility. However, studies in behavioural economics show that people …
to pursue maximised utility. However, studies in behavioural economics show that people …
[HTML][HTML] User behavior modeling for web search evaluation
Search engines are widely used in our daily life. Batch evaluation of the performance of
search systems to their users has always been an essential issue in the field of information …
search systems to their users has always been an essential issue in the field of information …
A reference-dependent model for web search evaluation: Understanding and measuring the experience of boundedly rational users
Previous researches demonstrate that users' actions in search interaction are associated
with relative gains and losses to reference points, known as the reference dependence …
with relative gains and losses to reference points, known as the reference dependence …
Ai can be cognitively biased: An exploratory study on threshold priming in llm-based batch relevance assessment
Cognitive biases are systematic deviations in thinking that lead to irrational judgments and
problematic decision-making, extensively studied across various fields. Recently, large …
problematic decision-making, extensively studied across various fields. Recently, large …
State-aware meta-evaluation of evaluation metrics in interactive information retrieval
In interactive IR (IIR), users often seek to achieve different goals (eg exploring a new topic,
finding a specific known item) at different search iterations and thus may evaluate system …
finding a specific known item) at different search iterations and thus may evaluate system …