The information retrieval experiment platform

M Fröbe, JH Reimer, S MacAvaney, N Deckers… - Proceedings of the 46th …, 2023 - dl.acm.org
We integrate irdatasets, ir_measures, and PyTerrier with TIRA in the Information Retrieval
Experiment Platform (TIREx) to promote more standardized, reproducible, scalable, and …

CC-News-En: A large English news corpus

J Mackenzie, R Benham, M Petri, JR Trippas… - Proceedings of the 29th …, 2020 - dl.acm.org
We describe a static, open-access news corpus using data from the Common Crawl
Foundation, who provide free, publicly available web archives, including a continuous crawl …

Can generative llms create query variants for test collections? an exploratory study

M Alaofi, L Gallagher, M Sanderson, F Scholer… - Proceedings of the 46th …, 2023 - dl.acm.org
This paper explores the utility of a Large Language Model (LLM) to automatically generate
queries and query variants from a description of an information need. Given a set of …

Evaluating the robustness of retrieval pipelines with query variation generators

G Penha, A Câmara, C Hauff - European conference on information …, 2022 - Springer
Heavily pre-trained transformers for language modeling, such as BERT, have shown to be
remarkably effective for Information Retrieval (IR) tasks, typically applied to re-rank the …

A relative information gain-based query performance prediction framework with generated query variants

S Datta, D Ganguly, M Mitra, D Greene - ACM Transactions on …, 2022 - dl.acm.org
Query performance prediction (QPP) methods, which aim to predict the performance of a
query, often rely on evidences in the form of different characteristic patterns in the …

An enhanced evaluation framework for query performance prediction

G Faggioli, O Zendel, JS Culpepper, N Ferro… - … on Information Retrieval, 2021 - Springer
Abstract Query Performance Prediction (QPP) has been studied extensively in the IR
community over the last two decades. A by-product of this research is a methodology to …

A study of a gain based approach for query aspects in recall oriented tasks

GM Di Nunzio, G Faggioli - Applied Sciences, 2021 - mdpi.com
Evidence-based healthcare integrates the best research evidence with clinical expertise in
order to make decisions based on the best practices available. In this context, the task of …

Query variation performance prediction for systematic reviews

H Scells, L Azzopardi, G Zuccon… - The 41st International ACM …, 2018 - dl.acm.org
When conducting systematic reviews, medical researchers heavily deliberate over the final
query to pose to the information retrieval system. Given the possible query variations that …

Where Do Queries Come From?

M Alaofi, L Gallagher, D Mckay, LL Saling… - Proceedings of the 45th …, 2022 - dl.acm.org
Where do queries--the words searchers type into a search box--come from? The Information
Retrieval community understands the performance of queries and search engines …

Incorporating user expectations and behavior into the measurement of search effectiveness

A Moffat, P Bailey, F Scholer, P Thomas - ACM Transactions on …, 2017 - dl.acm.org
Information retrieval systems aim to help users satisfy information needs. We argue that the
goal of the person using the system, and the pattern of behavior that they exhibit as they …