Crowdsourcing ground truth for medical relation extraction

A Dumitrache, L Aroyo, C Welty - ACM Transactions on Interactive …, 2018 - dl.acm.org
Cognitive computing systems require human labeled data for evaluation and often for
training. The standard practice used in gathering this data minimizes disagreement between …

Novel medical question and answer system: graph convolutional neural network based with knowledge graph optimization

X Wang, Z Luo, R He, Y Shao - Expert Systems with Applications, 2023 - Elsevier
In order to effectively integrate medical data and alleviate the problem of uneven distribution
of medical resources. In this paper, we combine the techniques of expert systems, graph …

From bias to repair: Error as a site of collaboration and negotiation in applied data science work

CK Lin, SJ Jackson - Proceedings of the ACM on Human-Computer …, 2023 - dl.acm.org
Managing error has become an increasingly central and contested arena within data
science work. While recent scholarship in artificial intelligence and machine learning has …

Characterization of time-variant and time-invariant assessment of suicidality on Reddit using C-SSRS

M Gaur, V Aribandi, A Alambo, U Kursuncu… - PloS one, 2021 - journals.plos.org
Suicide is the 10 th leading cause of death in the US (1999-2019). However, predicting
when someone will attempt suicide has been nearly impossible. In the modern world, many …

COVID-19 infodemic on Chinese social media: A 4P framework, selective review and research directions

J Luo, R Xue, J Hu - Measurement and Control, 2020 - journals.sagepub.com
During the outbreak of the COVID-19 (2019 coronavirus disease), misinformation related to
the virus spread rapidly online and have led to serious difficulties in controlling the disease …

From language models to large-scale food and biomedical knowledge graphs

G Cenikj, L Strojnik, R Angelski, N Ogrinc… - Scientific reports, 2023 - nature.com
Abstract Knowledge about the interactions between dietary and biomedical factors is
scattered throughout uncountable research articles in an unstructured form (eg, text, images …

Empirical methodology for crowdsourcing ground truth

A Dumitrache, O Inel, B Timmermans, C Ortiz… - Semantic …, 2021 - content.iospress.com
The process of gathering ground truth data through human annotation is a major bottleneck
in the use of information extraction methods for populating the Semantic Web …

SAFFRON: tranSfer leArning for Food-disease RelatiOn extractioN

G Cenikj, T Eftimov, BK Seljak - Proceedings of the 20th …, 2021 - aclanthology.org
The accelerating growth of big data in the biomedical domain, with an endless amount of
electronic health records and more than 30 million citations and abstracts in PubMed …

[PDF][PDF] Achieving expert-level annotation quality with crowdtruth

A Dumitrache, L Aroyo, C Welty - Proc. of BDM2I Workshop, ISWC, 2015 - ceur-ws.org
The lack of annotated datasets for training and benchmarking is one of the main challenges
of Clinical Natural Language Processing. In addition, current methods for collecting …

Would you describe a leopard as yellow? evaluating crowd-annotations with justified and informative disagreement

P Sommerauer, A Fokkens… - Proceedings of the 28th …, 2020 - aclanthology.org
Semantic annotation tasks contain ambiguity and vagueness and require varying degrees of
world knowledge. Disagreement is an important indication of these phenomena. Most …