In the last 16 years, more than 200 research articles were published about research-paper
recommender systems. We reviewed these articles and present some descriptive statistics in …

Abstract Evaluation conferences such as TREC, CLEF, and NTCIR are modern examples of
the Cranfield evaluation paradigm. In Cranfield, researchers perform experiments on test …

As recently as the 1990s, studies showed that most people preferred getting information
from other people rather than from information retrieval systems. Of course, in that time …

Recommender systems have been evaluated in many, often incomparable, ways. In this
article, we review the key decisions in evaluating collaborative filtering recommender …

This paper provides overview and instruction regarding the evaluation of interactive
information retrieval systems with users. The primary goal of this article is to catalog and …

Optimizing an interactive system against a predefined online metric is particularly
challenging, especially when the metric is computed from user feedback such as clicks and …

Recommender systems use people's opinions about items in an information domain to help
people choose other items. These systems have succeeded in domains as diverse as …

Use of test collections and evaluation measures to assess the effectiveness of information
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …

Several recent studies have demonstrated that the type of improvements in information
retrieval system effectiveness reported in forums such as SIGIR and TREC do not translate …

Over 80 approaches for academic literature recommendation exist today. The approaches
were introduced and evaluated in more than 170 research articles, as well as patents …