Normalised precision at fixed recall for evaluating tar

W Kusa, G Peikos, M Staudinger, A Lipani… - Proceedings of the …, 2024 - dl.acm.org
A popular approach to High-Recall Information Retrieval (HRIR) is Technology-Assisted
Review (TAR), which uses information retrieval and machine learning techniques to aid the …

SALτ: efficiently stop** TAR by improving priors estimates

A Molinari, A Esuli - Data Mining and Knowledge Discovery, 2024 - Springer
In high recall retrieval tasks, human experts review a large pool of documents with the goal
of satisfying an information need. Documents are prioritized for review through an active …

Goldilocks: Just-right tuning of bert for technology-assisted review

E Yang, S MacAvaney, DD Lewis, O Frieder - European Conference on …, 2022 - Springer
Technology-assisted review (TAR) refers to iterative active learning workflows for document
review in high recall retrieval (HRR) tasks. TAR research and most commercial TAR …

HC4: A new suite of test collections for ad hoc CLIR

D Lawrie, J Mayfield, DW Oard, E Yang - European Conference on …, 2022 - Springer
HC4 is a new suite of test collections for ad hoc Cross-Language Information Retrieval
(CLIR), with Common Crawl News documents in Chinese, Persian, and Russian, topics in …

Stop** Methods for Technology-assisted Reviews Based on Point Processes

M Stevenson, R Bin-Hezam - ACM Transactions on Information Systems, 2023 - dl.acm.org
Technology-assisted Review (TAR), which aims to reduce the effort required to screen
collections of documents for relevance, is used to develop systematic reviews of medical …

A reproducibility study of goldilocks: just-right tuning of BERT for TAR

X Mao, B Koopman, G Zuccon - European Conference on Information …, 2024 - Springer
Screening documents is a tedious and time-consuming aspect of high-recall retrieval tasks,
such as compiling a systematic literature review, where the goal is to identify all relevant …

Report on The Search Futures Workshop at ECIR 2024

L Azzopardi, CLA Clarke, P Kantor, B Mitra… - ACM SIGIR Forum, 2024 - dl.acm.org
The First Search Futures Workshop, in conjunction with the Fourty-sixth European
Conference on Information Retrieval (ECIR) 2024, looked into the future of search to ask …

Annotating data for fine-tuning a neural ranker? current active learning strategies are not better than random selection

S Althammer, G Zuccon, S Hofstätter… - Proceedings of the …, 2023 - dl.acm.org
Search methods based on Pretrained Language Models (PLM) have demonstrated great
effectiveness gains compared to statistical and early neural ranking models. However, fine …

RLStop: A Reinforcement Learning Stop** Method for TAR

R Bin-Hezam, M Stevenson - Proceedings of the 47th International ACM …, 2024 - dl.acm.org
We present RLStop, a novel Technology Assisted Review (TAR) stop** rule based on
reinforcement learning that helps minimise the number of documents that need to be …

Exploration of open large language models for ediscovery

S Pai, S Lahiri, U Kumar, K Baksi, E Soba… - Proceedings of the …, 2023 - aclanthology.org
The rapid advancement of Generative Artificial Intelligence (AI), particularly Large Language
Models (LLMs), has led to their widespread adoption for various natural language …