As recently as the 1990s, studies showed that most people preferred getting information
from other people rather than from information retrieval systems. Of course, in that time …

This paper describes how the Bootstrap approach to statistics can be applied to the
evaluation of IR effectiveness metrics. First, we argue that Bootstrap Hypothesis Tests …

Recently, a number of TREC tracks have adopted a retrieval effectiveness metric called
bpref which has been designed for evaluation environments with incomplete relevance data …

Background and objective In silico prediction of drug-target interactions (DTI) could provide
valuable information and speed-up the process of drug repositioning–finding novel usage …

Modern information retrieval (IR) test collections have grown in size, but the available
manpower for relevance assessments has more or less remained constant. Hence, how to …

There are several tasks where is preferable not responding than responding incorrectly. This
idea is not new, but despite several previous attempts there isn'ta commonly accepted …

Recent work on searching the Semantic Web has yielded a wide range of approaches with
respect to the underlying search mechanisms, results management and presentation, and …

Relevance is a key concept in information retrieval and widely used for the evaluation of
search systems using test collections. We present a comprehensive study of the effect of the …

Magnitude estimation is a psychophysical scaling technique for the measurement of
sensation, where observers assign numbers to stimuli in response to their perceived …

Abstract The field of Music Information Retrieval has always acknowledged the need for
rigorous scientific evaluations, and several efforts have set out to develop and provide the …