SemEval-2024 task 1: Semantic textual relatedness for african and asian languages

N Ousidhoum, SH Muhammad, M Abdalla… - arxiv preprint arxiv …, 2024 - arxiv.org
We present the first shared task on Semantic Textual Relatedness (STR). While earlier
shared tasks primarily focused on semantic similarity, we instead investigate the broader …

[HTML][HTML] Extracting sentence embeddings from pretrained transformer models

L Stankevičius, M Lukoševičius - Applied Sciences, 2024 - mdpi.com
Pre-trained transformer models shine in many natural language processing tasks and
therefore are expected to bear the representation of the input sentence or text meaning …

More DWUGs: Extending and evaluating word usage graph datasets in multiple languages

D Schlechtweg, P Cassotti, B Noble… - Proceedings of the …, 2024 - aclanthology.org
Abstract Word Usage Graphs (WUGs) represent human semantic proximity judgments for
pairs of word uses in a weighted graph, which can be clustered to infer word sense clusters …

C-STS: Conditional semantic textual similarity

A Deshpande, CE Jimenez, H Chen, V Murahari… - arxiv preprint arxiv …, 2023 - arxiv.org
Semantic textual similarity (STS), a cornerstone task in NLP, measures the degree of
similarity between a pair of sentences, and has broad application in fields such as …

Sugarcrepe++ dataset: Vision-language model sensitivity to semantic and lexical alterations

SH Dumpala, A Jaiswal, C Sastry, E Milios… - arxiv preprint arxiv …, 2024 - arxiv.org
Despite their remarkable successes, state-of-the-art large language models (LLMs),
including vision-and-language models (VLMs) and unimodal language models (ULMs), fail …

Compositionality and Sentence Meaning: Comparing Semantic Parsing and Transformers on a Challenging Sentence Similarity Dataset

J Fodor, S De Deyne, S Suzuki - Computational Linguistics, 2024 - direct.mit.edu
One of the major outstanding questions in computational semantics is how humans integrate
the meaning of individual words into a sentence in a way that enables understanding of …

Just rank: Rethinking evaluation with word and sentence similarities

B Wang, CCJ Kuo, H Li - arxiv preprint arxiv:2203.02679, 2022 - arxiv.org
Word and sentence embeddings are useful feature representations in natural language
processing. However, intrinsic evaluation for embeddings lags far behind, and there has …

NLU-STR at semeval-2024 task 1: Generative-based augmentation and encoder-based scoring for semantic textual relatedness

S Malaysha, M Jarrar, M Khalilia - arxiv preprint arxiv:2405.00659, 2024 - arxiv.org
Semantic textual relatedness is a broader concept of semantic similarity. It measures the
extent to which two chunks of text convey similar meaning or topics, or share related …

Best practices in the creation and use of emotion lexicons

SM Mohammad - arxiv preprint arxiv:2210.07206, 2022 - arxiv.org
Words play a central role in how we express ourselves. Lexicons of word-emotion
associations are widely used in research and real-world applications for sentiment analysis …

Sharif-str at semeval-2024 task 1: Transformer as a regression model for fine-grained scoring of textual semantic relations

SF Ebrahimi, KA Azari, A Iravani, H Alizadeh… - arxiv preprint arxiv …, 2024 - arxiv.org
Semantic Textual Relatedness holds significant relevance in Natural Language Processing,
finding applications across various domains. Traditionally, approaches to STR have relied …