[HTML][HTML] ChatGPT: Jack of all trades, master of none

J Kocoń, I Cichecki, O Kaszyca, M Kochanek, D Szydło… - Information …, 2023 - Elsevier
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and
revolutionized the approach in artificial intelligence to human-model interaction. The first …

Beyond the imitation game: Quantifying and extrapolating the capabilities of language models

A Srivastava, A Rastogi, A Rao, AAM Shoeb… - arxiv preprint arxiv …, 2022 - arxiv.org
Language models demonstrate both quantitative improvement and new qualitative
capabilities with increasing scale. Despite their potentially transformative impact, these new …

Knowledge enhanced contextual word representations

ME Peters, M Neumann, RL Logan IV… - arxiv preprint arxiv …, 2019 - arxiv.org
Contextual word representations, typically trained on unstructured, unlabeled text, do not
contain any explicit grounding to real world entities and are often unable to remember facts …

[PDF][PDF] Recent trends in word sense disambiguation: A survey

M Bevilacqua, T Pasini… - … Joint Conference on …, 2021 - researchportal.helsinki.fi
Abstract Word Sense Disambiguation (WSD) aims at making explicit the semantics of a word
in context by identifying the most suitable meaning from a predefined sense inventory …

Universal language model fine-tuning for text classification

J Howard, S Ruder - arxiv preprint arxiv:1801.06146, 2018 - arxiv.org
Inductive transfer learning has greatly impacted computer vision, but existing approaches in
NLP still require task-specific modifications and training from scratch. We propose Universal …

Detecting formal thought disorder by deep contextualized word representations

J Sarzynska-Wawer, A Wawer, A Pawlak… - Psychiatry …, 2021 - Elsevier
Computational linguistics has enabled the introduction of objective tools that measure some
of the symptoms of schizophrenia, including the coherence of speech associated with formal …

Visualizing and measuring the geometry of BERT

E Reif, A Yuan, M Wattenberg… - Advances in neural …, 2019 - proceedings.neurips.cc
Transformer architectures show significant promise for natural language processing. Given
that a single pretrained model can be fine-tuned to perform well on many different tasks …

GlossBERT: BERT for word sense disambiguation with gloss knowledge

L Huang, C Sun, X Qiu, X Huang - arxiv preprint arxiv:1908.07245, 2019 - arxiv.org
Word Sense Disambiguation (WSD) aims to find the exact sense of an ambiguous word in a
particular context. Traditional supervised methods rarely take into consideration the lexical …

A survey on semantic processing techniques

R Mao, K He, X Zhang, G Chen, J Ni, Z Yang… - Information …, 2024 - Elsevier
Semantic processing is a fundamental research domain in computational linguistics. In the
era of powerful pre-trained language models and large language models, the advancement …

From word to sense embeddings: A survey on vector representations of meaning

J Camacho-Collados, MT Pilehvar - Journal of Artificial Intelligence …, 2018 - jair.org
Over the past years, distributed semantic representations have proved to be effective and
flexible keepers of prior knowledge to be integrated into downstream applications. This …