Semantics of Multiword Expressions in Transformer-Based Models: A Survey

F Miletić, SS Walde - … of the Association for Computational Linguistics, 2024 - direct.mit.edu
Multiword expressions (MWEs) are composed of multiple words and exhibit variable
degrees of compositionality. As such, their meanings are notoriously difficult to model, and it …

Non-compositional Expression Generation Based on Curriculum Learning and Continual Learning

J Zhou, Z Zeng, H Gong, S Bhat - Findings of the Association for …, 2023 - aclanthology.org
Non-compositional expressions, by virtue of their non-compositionality, are a classic 'pain in
the neck'for NLP systems. Different from the general language modeling and generation …

IEKG: A Commonsense Knowledge Graph for Idiomatic Expressions

Z Zeng, KT Cheng, SV Nanniyur, J Zhou… - arxiv preprint arxiv …, 2023 - arxiv.org
Idiomatic expression (IE) processing and comprehension have challenged pre-trained
language models (PTLMs) because their meanings are non-compositional. Unlike prior …

Investigating Idiomaticity in Word Representations

W He, TK Vieira, M Garcia, C Scarton, M Idiart… - Computational …, 2024 - direct.mit.edu
Idiomatic expressions are an integral part of human languages, often used to express
complex ideas in compressed or conventional ways (eg eager beaver as a keen and …

Unified Representation for Non-compositional and Compositional Expressions

Z Zeng, S Bhat - arxiv preprint arxiv:2310.19127, 2023 - arxiv.org
Accurate processing of non-compositional language relies on generating good
representations for such expressions. In this work, we study the representation of language …

No Context Needed: Contextual Quandary In Idiomatic Reasoning With Pre-Trained Language Models

K Cheng, S Bhat - Proceedings of the 2024 Conference of the …, 2024 - aclanthology.org
Abstract Reasoning in the presence of idiomatic expressions (IEs) remains a challenging
frontier in natural language understanding (NLU). Unlike standard text, the non …

Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Loss

W He, M Idiart, C Scarton, A Villavicencio - arxiv preprint arxiv …, 2024 - arxiv.org
Accurately modeling idiomatic or non-compositional language has been a longstanding
challenge in Natural Language Processing (NLP). This is partly because these expressions …

Unsupervised Paraphrasing of Multiword Expressions

T Wada, Y Matsumoto, T Baldwin, JH Lau - arxiv preprint arxiv …, 2023 - arxiv.org
We propose an unsupervised approach to paraphrasing multiword expressions (MWEs) in
context. Our model employs only monolingual corpus data and pre-trained language models …

Natural Language Processing for Slang

Z Sun - 2024 - search.proquest.com
Slang is a common type of language that makes creative and highly flexible use of words. A
basic problem that language users tackle is how to develop and interpret novel slang terms …