Semeval-2022 task 11: Multilingual complex named entity recognition (multiconer)

S Malmasi, A Fang, B Fetahu, S Kar… - Proceedings of the …, 2022 - aclanthology.org
We present the findings of SemEval-2022 Task 11 on Multilingual Complex Named Entity
Recognition MULTICONER. Divided into 13 tracks, the task focused on methods to identify …

Semeval-2022 task 6: isarcasmeval, intended sarcasm detection in english and arabic

IA Farha, S Oprea, S Wilson… - The 16th International …, 2022 - research.ed.ac.uk
Abstract iSarcasmEval is the first shared task to target intended sarcasm detection: the data
for this task was provided and labelled by the authors of the texts themselves. Such an …

Bigbio: A framework for data-centric biomedical natural language processing

J Fries, L Weber, N Seelam, G Altay… - Advances in …, 2022 - proceedings.neurips.cc
Training and evaluating language models increasingly requires the construction of meta-
datasets--diverse collections of curated data with clear provenance. Natural language …

Why don't you do it right? analysing annotators' disagreement in subjective tasks

M Sandri, E Leonardelli, S Tonelli… - Proceedings of the 17th …, 2023 - aclanthology.org
Annotators' disagreement in linguistic data has been recently the focus of multiple initiatives
aimed at raising awareness on issues related to 'majority voting'when aggregating diverging …

SemEval-2023 task 5: Clickbait spoiling

M Fröbe, B Stein, T Gollub, M Hagen… - Proceedings of the 17th …, 2023 - aclanthology.org
In this overview paper, we report on the second PAN~ Clickbait Challenge hosted as Task~
5 at SemEval~ 2023. The challenge's focus is to better support social media users by …

Findings of the VarDial evaluation campaign 2023

N Aepli, Ç Çöltekin, R Van Der Goot… - arxiv preprint arxiv …, 2023 - arxiv.org
This report presents the results of the shared tasks organized as part of the VarDial
Evaluation Campaign 2023. The campaign is part of the tenth workshop on Natural …

SkillSpan: Hard and soft skill extraction from English job postings

M Zhang, KN Jensen, SD Sonniks, B Plank - arxiv preprint arxiv …, 2022 - arxiv.org
Skill Extraction (SE) is an important and widely-studied task useful to gain insights into labor
market dynamics. However, there is a lacuna of datasets and annotation guidelines; …

[PDF][PDF] MultiLexNorm: A shared task on multilingual lexical normalization

R Van Der Goot, A Ramponi, A Zubiaga… - Seventh Workshop on …, 2021 - pure.itu.dk
Lexical normalization is the task of transforming an utterance into its standardized form. This
task is beneficial for downstream analysis, as it provides a way to harmonize (often …

SemEval-2023 task 8: Causal medical claim identification and related PIO frame extraction from social media posts

V Khetan, S Wadhwa, BC Wallace… - Proceedings of the 17th …, 2023 - aclanthology.org
Identification of medical claims from user-generated text data is an onerous but essential
step for various tasks including content moderation, and hypothesis generation. SemEval …

End-to-end argument mining with cross-corpora multi-task learning

G Morio, H Ozaki, T Morishita, K Yanai - Transactions of the …, 2022 - direct.mit.edu
Mining an argument structure from text is an important step for tasks such as argument
search and summarization. While studies on argument (ation) mining have proposed …