We integrate irdatasets, ir_measures, and PyTerrier with TIRA in the Information Retrieval
Experiment Platform (TIREx) to promote more standardized, reproducible, scalable, and …

The zero-shot effectiveness of neural retrieval models is often evaluated on the BEIR
benchmark---a combination of different IR evaluation datasets. Interestingly, previous …

Spoken Conversational Search (SCS) poses unique challenges in understanding user-
system interactions due to the absence of visual cues, and the complexity of less structured …

Machine Learning is an interesting tool for stance recognition in a large-scale context, in
terms of data size, but also regarding the topics and themes addressed or the languages …

This paper is the extended overview of Touché: the fifth edition of the lab on argumentation
systems that was held at CLEF 2024. With the goal to foster the development of support …

Touché task 4 evaluates systems performing stance detection in a multilingual setting where
a reduced annotated dataset is available. We have tested different approaches focused on …

Abstract 2024 marks the 25 th birthday for CLEF, an evaluation campaign activity which has
applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal …

Stance classification can be used in various scenarios, such as fake news detection or
public opinion measurement. However, little work has been done on stance detection in …

Touché 2023 task 4 evaluated stance detection in a Multilingual multi-target setting with a
reduced annotated dataset. This is why we have tested different approaches focused on …

This paper presents our (team Renji Abarai) participation in Touché 2023 Task on Argument
Retrieval for Controversial Questions. In our approaches submitted to the task, we …