Informing the design of spoken conversational search: Perspective paper

JR Trippas, D Spina, L Cavedon, H Joho… - Proceedings of the …, 2018 - dl.acm.org
We conducted a laboratory-based observational study where pairs of people performed
search tasks communicating verbally. Examination of the discourse allowed commonly used …

CC-News-En: A large English news corpus

J Mackenzie, R Benham, M Petri, JR Trippas… - Proceedings of the 29th …, 2020 - dl.acm.org
We describe a static, open-access news corpus using data from the Common Crawl
Foundation, who provide free, publicly available web archives, including a continuous crawl …

Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework

D Kelly, J Arguello, A Edwards, W Wu - Proceedings of the 2015 …, 2015 - dl.acm.org
One of the most challenging aspects of designing interactive information retrieval (IIR)
experiments with users is the development of search tasks. We describe an evaluation of 20 …

Evaluating the robustness of retrieval pipelines with query variation generators

G Penha, A Câmara, C Hauff - European conference on information …, 2022 - Springer
Heavily pre-trained transformers for language modeling, such as BERT, have shown to be
remarkably effective for Information Retrieval (IR) tasks, typically applied to re-rank the …

Towards a model for spoken conversational search

JR Trippas, D Spina, P Thomas, M Sanderson… - Information Processing …, 2020 - Elsevier
Conversation is the natural mode for information exchange in daily life, a spoken
conversational interaction for search input and output is a logical format for information …

Towards multi-modal conversational information seeking

Y Deldjoo, JR Trippas, H Zamani - … of the 44th International ACM SIGIR …, 2021 - dl.acm.org
Recent research on conversational information seeking (CIS) mostly focuses on uni-modal
interactions and information items. This per-spective paper highlights the importance of …

Overview of the CLEF eHealth evaluation lab 2019

L Kelly, H Suominen, L Goeuriot, M Neves… - Experimental IR Meets …, 2019 - Springer
In this paper, we provide an overview of the seventh annual edition of the CLEF eHealth
evaluation lab. CLEF eHealth 2019 continues our evaluation resource building efforts …

Where do queries come from?

M Alaofi, L Gallagher, D Mckay, LL Saling… - Proceedings of the 45th …, 2022 - dl.acm.org
Where do queries--the words searchers type into a search box--come from? The Information
Retrieval community understands the performance of queries and search engines …

Incorporating user expectations and behavior into the measurement of search effectiveness

A Moffat, P Bailey, F Scholer, P Thomas - ACM Transactions on …, 2017 - dl.acm.org
Information retrieval systems aim to help users satisfy information needs. We argue that the
goal of the person using the system, and the pattern of behavior that they exhibit as they …

UQV100: A test collection with query variability

P Bailey, A Moffat, F Scholer, P Thomas - Proceedings of the 39th …, 2016 - dl.acm.org
We describe the UQV100 test collection, designed to incorporate variability from users.
Information need? backstories? were written for 100 topics (or sub-topics) from the TREC …