The many dimensions of truthfulness: Crowdsourcing misinformation assessments on a multidimensional scale

M Soprano, K Roitero, D La Barbera, D Ceolin… - Information Processing …, 2021 - Elsevier
Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating
the truthfulness of public statements. Under certain conditions such as:(1) having a balanced …

[HTML][HTML] Crowdsourced Fact-checking: Does It Actually Work?

D La Barbera, E Maddalena, M Soprano… - Information Processing …, 2024 - Elsevier
There is an important ongoing effort aimed to tackle misinformation and to perform reliable
fact-checking by employing human assessors at scale, with a crowdsourcing-based …

The effects of crowd worker biases in fact-checking tasks

T Draws, D La Barbera, M Soprano, K Roitero… - Proceedings of the …, 2022 - dl.acm.org
Due to the increasing amount of information shared online every day, the need for sound
and reliable ways of distinguishing between trustworthy and non-trustworthy information is …

Can the crowd identify misinformation objectively? The effects of judgment scale and assessor's background

K Roitero, M Soprano, S Fan, D Spina… - Proceedings of the 43rd …, 2020 - dl.acm.org
Truthfulness judgments are a fundamental step in the process of fighting misinformation, as
they are crucial to train and evaluate classifiers that automatically distinguish true and false …

Who's in the crowd matters: cognitive factors and beliefs predict misinformation assessment accuracy

RA Kaufman, MR Haupt, SP Dow - Proceedings of the ACM on Human …, 2022 - dl.acm.org
Misinformation runs rampant on social media and has been tied to adverse health behaviors
such as vaccine hesitancy. Crowdsourcing can be a means to detect and impede the spread …

Crowdsourcing truthfulness: The impact of judgment scale and assessor bias

D La Barbera, K Roitero, G Demartini, S Mizzaro… - Advances in Information …, 2020 - Springer
News content can sometimes be misleading and influence users' decision making
processes (eg, voting decisions). Quantitatively assessing the truthfulness of content …

On the role of large language models in crowdsourcing misinformation assessment

J Xu, L Han, S Sadiq, G Demartini - Proceedings of the International …, 2024 - ojs.aaai.org
The proliferation of online misinformation significantly undermines the credibility of web
content. Recently, crowd workers have been successfully employed to assess …

Annotating perspectives on vaccination

R Morante, C Van Son, I Maks… - Proceedings of the Twelfth …, 2020 - aclanthology.org
In this paper we present the Vaccination Corpus, a corpus of texts related to the online
vaccination debate that has been annotated with three layers of information about …

Task design in complex crowdsourcing experiments: Item assignment optimization

S Ceschia, K Roitero, G Demartini, S Mizzaro… - Computers & Operations …, 2022 - Elsevier
Crowdsourcing is the practice of outsourcing a task that would otherwise be performed by
one or a few experts to a crowd of individuals. It is often used to collect large amounts of …

On the Impact of Showing Evidence from Peers in Crowdsourced Truthfulness Assessments

J Xu, L Han, S Sadiq, G Demartini - ACM Transactions on Information …, 2024 - dl.acm.org
Misinformation has been rapidly spreading online. The common approach to dealing with it
is deploying expert fact-checkers who follow forensic processes to identify the veracity of …