We address the problems of 1/assessing the confidence of the standard point estimates,
precision, recall and F-score, and 2/comparing the results, in terms of precision, recall and F …

The Handbook of Natural Language Processing, Second Edition presents practical tools
and techniques for implementing natural language processing in computer systems. Along …

Information retrieval (IR) researchers commonly use three tests of statistical significance: the
Student's paired t-test, the Wilcoxon signed rank test, and the sign test. Other researchers …

Use of test collections and evaluation measures to assess the effectiveness of information
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …

We conducted a systematic review of 840 SIGIR full papers and 215 TOIS papers published
between 2006 and 2015. The original objective of the study was to identify IR effectiveness …

Two stages in measurement of techniques for information retrieval are gathering of
documents for relevance assessment and use of the assessments to numerically evaluate …

The effectiveness of information retrieval systems is measured by comparing performance
on a common set of queries and documents. Significance tests are often used to evaluate …

Thermal images of plants have been used as a way for monitoring water status since it does
provide a non-destructive method that allows its remote evaluation. Even with the facilities …

This paper describes how the Bootstrap approach to statistics can be applied to the
evaluation of IR effectiveness metrics. First, we argue that Bootstrap Hypothesis Tests …

Statistical significance testing is widely accepted as a means to assess how well a difference
in effectiveness reflects an actual difference between systems, as opposed to random noise …