Natural language processing for requirements engineering: A systematic map** study

L Zhao, W Alhoshan, A Ferrari, KJ Letsholo… - ACM Computing …, 2021 - dl.acm.org
Natural Language Processing for Requirements Engineering (NLP4RE) is an area of
research and development that seeks to apply natural language processing (NLP) …

[PDF][PDF] Polysemy—evidence from linguistics, behavioral science, and contextualized language models

J Haber, M Poesio - Computational Linguistics, 2024 - direct.mit.edu
Polysemy is the type of lexical ambiguity where a word has multiple distinct but related
interpretations. In the past decade, it has been the subject of a great many studies across …

Universal language model fine-tuning for text classification

J Howard, S Ruder - arxiv preprint arxiv:1801.06146, 2018 - arxiv.org
Inductive transfer learning has greatly impacted computer vision, but existing approaches in
NLP still require task-specific modifications and training from scratch. We propose Universal …

Detecting formal thought disorder by deep contextualized word representations

J Sarzynska-Wawer, A Wawer, A Pawlak… - Psychiatry …, 2021 - Elsevier
Computational linguistics has enabled the introduction of objective tools that measure some
of the symptoms of schizophrenia, including the coherence of speech associated with formal …

A survey on semantic processing techniques

R Mao, K He, X Zhang, G Chen, J Ni, Z Yang… - Information …, 2024 - Elsevier
Semantic processing is a fundamental research domain in computational linguistics. In the
era of powerful pre-trained language models and large language models, the advancement …

GlossBERT: BERT for word sense disambiguation with gloss knowledge

L Huang, C Sun, X Qiu, X Huang - arxiv preprint arxiv:1908.07245, 2019 - arxiv.org
Word Sense Disambiguation (WSD) aims to find the exact sense of an ambiguous word in a
particular context. Traditional supervised methods rarely take into consideration the lexical …

From word to sense embeddings: A survey on vector representations of meaning

J Camacho-Collados, MT Pilehvar - Journal of Artificial Intelligence …, 2018 - jair.org
Over the past years, distributed semantic representations have proved to be effective and
flexible keepers of prior knowledge to be integrated into downstream applications. This …

SenseBERT: Driving some sense into BERT

Y Levine, B Lenz, O Dagan, O Ram, D Padnos… - arxiv preprint arxiv …, 2019 - arxiv.org
The ability to learn from large unlabeled corpora has allowed neural language models to
advance the frontier in natural language understanding. However, existing self-supervision …

Word sense disambiguation: A unified evaluation framework and empirical comparison

A Raganato, J Camacho-Collados… - Proceedings of the …, 2017 - researchportal.helsinki.fi
Abstract Word Sense Disambiguation is a long-standing task in Natural Language
Processing, lying at the core of human language understanding. However, the evaluation of …

Moving down the long tail of word sense disambiguation with gloss-informed biencoders

T Blevins, L Zettlemoyer - arxiv preprint arxiv:2005.02590, 2020 - arxiv.org
A major obstacle in Word Sense Disambiguation (WSD) is that word senses are not
uniformly distributed, causing existing models to generally perform poorly on senses that are …