A systematic review of cost, effort, and load research in information search and retrieval, 1972–2020

M McGregor, L Azzopardi, M Halvey - ACM Transactions on Information …, 2023 - dl.acm.org
During the information search and retrieval (ISR) process, user-system interactions such as
submitting queries, examining results, and engaging with information impose some degree …

Generative information retrieval evaluation

M Alaofi, N Arabzadeh, CLA Clarke… - Information Access in the …, 2024 - Springer
In this chapter, we consider generative information retrieval (IR) evaluation from two distinct
but interrelated perspectives. First, Large Language Models (LLMs) themselves are rapidly …

Searching and stop**: An analysis of stop** rules and strategies

D Maxwell, L Azzopardi, K Järvelin… - Proceedings of the 24th …, 2015 - dl.acm.org
Searching naturally involves stop** points, both at a query level (how far down the ranked
list should I go?) and at a session level (how many queries should I issue?). Understanding …

Impacts of time constraints and system delays on user experience

A Crescenzi, D Kelly, L Azzopardi - Proceedings of the 2016 acm on …, 2016 - dl.acm.org
During information search, people often experience time pressure. This might be a result of
a deadline, the system's performance or some other event. In this paper, we report results of …

Searching, learning, and subtopic ordering: A simulation-based analysis

A Câmara, D Maxwell, C Hauff - European Conference on Information …, 2022 - Springer
Complex search tasks—such as those from the Search as Learning (SAL) domain—often
result in users develo** an information need composed of several aspects. However …

Agents, simulated users and humans: An analysis of performance and behaviour

D Maxwell, L Azzopardi - Proceedings of the 25th ACM international on …, 2016 - dl.acm.org
Most of the current models that are used to simulate users in Interactive Information Retrieval
(IIR) lack realism and agency. Such models generally make decisions in a stochastic …

Understanding and leveraging the impact of response latency on user behaviour in web search

X Bai, I Arapakis, BB Cambazoglu… - ACM Transactions on …, 2017 - dl.acm.org
The interplay between the response latency of web search systems and users' search
experience has only recently started to attract research attention, despite the important …

Don't forget the user: It's time to rethink network measurements

A Taneja, R Bothra, D Bhattacherjee… - Proceedings of the …, 2023 - dl.acm.org
Network measurement has long focused on the bits and bytes---low-level network metrics
such as latency and throughput, which have the advantage of being objective and directly …

Untangling cost, effort, and load in information seeking and retrieval

M McGregor, L Azzopardi, M Halvey - … of the 2021 conference on human …, 2021 - dl.acm.org
When performing Information Seeking and Retrieval (ISR) activities, people submit queries,
examine results, assess documents and engage with the information to make decisions and …