Pyserini is a Python toolkit for reproducible information retrieval research with sparse and
dense representations. It aims to provide effective, reproducible, and easy-to-use first-stage …

Software toolkits play an essential role in information retrieval research. Most open-source
toolkits developed by academics are designed to facilitate the evaluation of retrieval models …

This work tackles the perennial problem of reproducible baselines in information retrieval
research, focusing on bag-of-words ranking models. Although academic information …

Reproducibility is a key requirement for scientific progress. It allows the reproduction of the
works of others, and, as a consequence, to fully trust the reported claims and results. In this …

The Dagstuhl Seminar on" Reproducibility of Data-Oriented Experiments in e-Science", held
on 24-29 January 2016, focused on the core issues and approaches to reproducibility of …

Recently, the machine learning community paused in a moment of self-reflection. In a
widelydiscussed paper at ICLR 2018, Sculley et al.[13] wrote:" We observe that the rate of …

Pyserini is an easy-to-use Python toolkit that supports replicable IR research by providing
effective first-stage retrieval in a multi-stage ranking architecture. Our toolkit is self-contained …

Science is facing a so-called reproducibility crisis, where researchers struggle to repeat
experiments and to get the same or comparable results. This represents a fundamental …

Information Retrieval (IR) is concerned with ranking information resources with respect to
user information needs, delivering a wide range of key applications for industry and society …

Replicability and reproducibility of experimental results are primary concerns in all the areas
of science and IR is not an exception. Besides the problem of moving the field towards more …