Measuring the utility of search engine result pages: an information foraging based measure

L Azzopardi, P Thomas, N Craswell - The 41st International ACM SIGIR …, 2018‏ - dl.acm.org
Web Search Engine Result Pages (SERPs) are complex responses to queries, containing
many heterogeneous result elements (web results, advertisements, and specialised" …

Modelling interaction with economic models of search

L Azzopardi - Proceedings of the 37th international ACM SIGIR …, 2014‏ - dl.acm.org
Understanding how people interact when searching is central to the study of Interactive
Information Retrieval (IIR). Most of the prior work has either been conceptual, observational …

Information Retrieval Systems in Healthcare: Understanding Medical Data Through Text Analysis

S Panja - Transformative Approaches to Patient Literacy and …, 2024‏ - igi-global.com
Healthcare systems generate an immense volume of data, which presents a unique
opportunity to make a significant impact. This chapter examines the role of information …

A flexible framework for offline effectiveness metrics

A Moffat, J Mackenzie, P Thomas… - Proceedings of the 45th …, 2022‏ - dl.acm.org
The use of offline effectiveness metrics is one of the cornerstones of evaluation in
information retrieval. Static resources that include test collections and sets of topics, the …

Metrics, statistics, tests

T Sakai - PROMISE winter school, 2013‏ - Springer
This lecture is intended to serve as an introduction to Information Retrieval (IR) effectiveness
metrics and their usage in IR experiments using test collections. Evaluation metrics are …

Task-based information interaction evaluation: The viewpoint of program theory

K Järvelin, P Vakkari, P Arvola, F Baskaya… - ACM Transactions on …, 2015‏ - dl.acm.org
Evaluation is central in research and development of information retrieval (IR). In addition to
designing and implementing new retrieval mechanisms, one must also show through …

Constructing better evaluation metrics by incorporating the anchoring effect into the user model

N Chen, F Zhang, T Sakai - Proceedings of the 45th international ACM …, 2022‏ - dl.acm.org
Models of existing evaluation metrics assume that users are rational decision-makers trying
to pursue maximised utility. However, studies in behavioural economics show that people …

Offline evaluation by maximum similarity to an ideal ranking

CLA Clarke, MD Smucker, A Vtyurina - Proceedings of the 29th ACM …, 2020‏ - dl.acm.org
NDCG and similar measures remain standard for the offline evaluation of search,
recommendation, question answering and similar systems. These measures require …

Retrieval evaluation measures that agree with users' SERP preferences: Traditional, preference-based, and diversity measures

T Sakai, Z Zeng - ACM Transactions on Information Systems (TOIS), 2020‏ - dl.acm.org
We examine the “goodness” of ranked retrieval evaluation measures in terms of how well
they align with users' Search Engine Result Page (SERP) preferences for web search. The …

A reference-dependent model for web search evaluation: Understanding and measuring the experience of boundedly rational users

N Chen, J Liu, T Sakai - Proceedings of the ACM web conference 2023, 2023‏ - dl.acm.org
Previous researches demonstrate that users' actions in search interaction are associated
with relative gains and losses to reference points, known as the reference dependence …