Generative information retrieval evaluation

M Alaofi, N Arabzadeh, CLA Clarke… - Information Access in the …, 2024 - Springer
In this chapter, we consider generative information retrieval (IR) evaluation from two distinct
but interrelated perspectives. First, Large Language Models (LLMs) themselves are rapidly …

Searching and stop**: An analysis of stop** rules and strategies

D Maxwell, L Azzopardi, K Järvelin… - Proceedings of the 24th …, 2015 - dl.acm.org
Searching naturally involves stop** points, both at a query level (how far down the ranked
list should I go?) and at a session level (how many queries should I issue?). Understanding …

Searching, learning, and subtopic ordering: A simulation-based analysis

A Câmara, D Maxwell, C Hauff - European Conference on Information …, 2022 - Springer
Complex search tasks—such as those from the Search as Learning (SAL) domain—often
result in users develo** an information need composed of several aspects. However …

A systematic review of cost, effort, and load research in information search and retrieval, 1972–2020

M McGregor, L Azzopardi, M Halvey - ACM Transactions on Information …, 2023 - dl.acm.org
During the information search and retrieval (ISR) process, user-system interactions such as
submitting queries, examining results, and engaging with information impose some degree …

Impacts of time constraints and system delays on user experience

A Crescenzi, D Kelly, L Azzopardi - Proceedings of the 2016 acm on …, 2016 - dl.acm.org
During information search, people often experience time pressure. This might be a result of
a deadline, the system's performance or some other event. In this paper, we report results of …

Agents, simulated users and humans: An analysis of performance and behaviour

D Maxwell, L Azzopardi - Proceedings of the 25th ACM international on …, 2016 - dl.acm.org
Most of the current models that are used to simulate users in Interactive Information Retrieval
(IIR) lack realism and agency. Such models generally make decisions in a stochastic …

Modelling search and stop** in interactive information retrieval

DM Maxwell - 2019 - theses.gla.ac.uk
Searching for information when using a computerised retrieval system is a complex and
inherently interactive process. Individuals during a search session may issue multiple …

Untangling cost, effort, and load in information seeking and retrieval

M McGregor, L Azzopardi, M Halvey - … of the 2021 conference on human …, 2021 - dl.acm.org
When performing Information Seeking and Retrieval (ISR) activities, people submit queries,
examine results, assess documents and engage with the information to make decisions and …

Understanding and leveraging the impact of response latency on user behaviour in web search

X Bai, I Arapakis, BB Cambazoglu… - ACM Transactions on …, 2017 - dl.acm.org
The interplay between the response latency of web search systems and users' search
experience has only recently started to attract research attention, despite the important …

Time pressure and system delays in information search

A Crescenzi, D Kelly, L Azzopardi - … of the 38th International ACM SIGIR …, 2015 - dl.acm.org
We report preliminary results of the impact of time pressure and system delays on search
behavior from a laboratory study with forty-three participants. To induce time pressure, we …