Large language models (LLMs) have recently been applied in software engineering to
perform tasks such as translating code between programming languages, generating code …

With the emergence of various information access systems exhibiting increasing complexity,
there is a critical need for sound and scalable means of automatic evaluation. To address …

Eye-tracking research is beneficial for better understanding user behaviour in search
engines. The present paper presents a comprehensive narrative literature review of eye …

Offline evaluation is an essential complement to online experiments in the selection,
improvement, tuning, and deployment of recommender systems. Offline methodologies for …

Information seeking conversations between users and Conversational Search Agents
(CSAs) consist of multiple turns of interaction. While users initiate a search session, ideally a …

Conversational information retrieval is a relatively new and fast-develo** research area,
but conversation itself has been well studied for decades. Researchers have analysed …

This study evaluates 30 IR evaluation measures or their instances, of which nine are for
adhoc IR and 21 are for diversified IR, primarily from the viewpoint of whether their …

The use of offline effectiveness metrics is one of the cornerstones of evaluation in
information retrieval. Static resources that include test collections and sets of topics, the …

Evaluation metrics play an important role in the batch evaluation of IR systems. Based on a
user model that describes how users interact with the rank list, an evaluation metric is …

Using a Web search engine is one of today's most frequent activities. Exploratory search
activities which are carried out in order to gain knowledge are conceptualized and denoted …