Overview of the CLEF-2024 CheckThat! lab: check-worthiness, subjectivity, persuasion, roles, authorities, and adversarial robustness

A Barrón-Cedeño, F Alam, JM Struß, P Nakov… - … Conference of the Cross …, 2024 - Springer
We describe the seventh edition of the CheckThat! lab, part of the 2024 Conference and
Labs of the Evaluation Forum (CLEF). Previous editions of CheckThat! focused on the main …

Overview of the CLEF-2024 CheckThat! lab task 1 on check-worthiness estimation of multigenre content

M Hasanain, R Suwaileh, S Weering, C Li… - 25th Working Notes of …, 2024 - research.rug.nl
We present an overview of the CheckThat! Lab 2024 Task 1, part of CLEF 2024. Task 1
involves determining whether a text item is check-worthy, with a special emphasis on COVID …

[PDF][PDF] Overview of the CLEF-2024 CheckThat! Lab task 5 on rumor verification using evidence from authorities

F Haouari, T Elsayed, R Suwaileh - Faggioli et al.[22], 2024 - ceur-ws.org
We present an overview of Task 5 of the seventh edition of the CheckThat! Lab, which is a
part of the 2024 Conference and Labs of the Evaluation Forum (CLEF). In the Rumor …

[PDF][PDF] Overview of the CLEF-2024 CheckThat! Lab task 6 on robustness of credibility assessment with adversarial examples (InCrediblAE)

P Przybyła, B Wu, A Shvets, Y Mu, KC Sheang… - Working Notes of …, 2024 - ceur-ws.org
Abstract Task 6 at CheckThat! Lab, organised at CLEF-2024, is devoted to assessing the
robustness of misinformation detection solutions implemented as text classification models …

IAI group at CheckThat! 2024: transformer models and data augmentation for checkworthy claim detection

PR Aarnes, V Setty, P Galuščáková - arxiv preprint arxiv:2408.01118, 2024 - arxiv.org
This paper describes IAI group's participation for automated check-worthiness estimation for
claims, within the framework of the 2024 CheckThat! Lab" Task 1: Check-Worthiness …

[PDF][PDF] MMU NLP at CheckThat! 2024: homoglyphs are adversarial attacks

C Roadhouse, M Shardlow, A Williams - Faggioli et al.[22], 2024 - ceur-ws.org
Work on adversarial attacks is becoming more necessary with the growing amount of
misinformation online, as it can bolster future defence techniques. In this paper, we present …

[PDF][PDF] CLaC at CheckThat! 2024: a zero-shot model for check-worthiness and subjectivity classification

S Gruman, L Kosseim - Faggioli et al.[22], 2024 - ceur-ws.org
In this paper, we describe our approach to CLEF 2024 Lab 2 CheckThat! Task 1 (Check-
worthiness) and Task 2 (Subjectivity), which aims to evaluate how consistent Large …

A Survey on Automatic Credibility Assessment of Textual Credibility Signals in the Era of Large Language Models

I Srba, O Razuvayevskaya, JA Leite, R Moro… - arxiv preprint arxiv …, 2024 - arxiv.org
In the current era of social media and generative AI, an ability to automatically assess the
credibility of online social media content is of tremendous importance. Credibility …

Nullpointer at CheckThat! 2024: identifying subjectivity from multilingual text sequence

MR Biswas, AT Abir, W Zaghouani - arxiv preprint arxiv:2407.10252, 2024 - arxiv.org
This study addresses a binary classification task to determine whether a text sequence,
either a sentence or paragraph, is subjective or objective. The task spans five languages …

[PDF][PDF] SemanticCuetSync at CheckThat! 2024: finding subjectivity in news article using Llama

AI Paran, MS Hossain, SH Shohan, J Hossain… - Faggioli et al.[22 …, 2024 - ceur-ws.org
This study introduces an LLM-based technique for detecting subjectivity and objectivity in
English and Arabic news articles. Although several transformers, deep learning (DL), and …