Transformer models for text-based emotion detection: a review of BERT-based approaches

FA Acheampong, H Nunoo-Mensah… - Artificial Intelligence …, 2021 - Springer
We cannot overemphasize the essence of contextual information in most natural language
processing (NLP) applications. The extraction of context yields significant improvements in …

Pre-trained models for natural language processing: A survey

X Qiu, T Sun, Y Xu, Y Shao, N Dai, X Huang - Science China …, 2020 - Springer
Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …

A survey on rag meeting llms: Towards retrieval-augmented large language models

W Fan, Y Ding, L Ning, S Wang, H Li, D Yin… - Proceedings of the 30th …, 2024 - dl.acm.org
As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can
offer reliable and up-to-date external knowledge, providing huge convenience for numerous …

A survey on aspect-based sentiment analysis: Tasks, methods, and challenges

W Zhang, X Li, Y Deng, L Bing… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
As an important fine-grained sentiment analysis problem, aspect-based sentiment analysis
(ABSA), aiming to analyze and understand people's opinions at the aspect level, has been …

The biases of pre-trained language models: An empirical study on prompt-based sentiment analysis and emotion detection

R Mao, Q Liu, K He, W Li… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Thanks to the breakthrough of large-scale pre-trained language model (PLM) technology,
prompt-based classification tasks, eg, sentiment analysis and emotion detection, have …

Don't stop pretraining: Adapt language models to domains and tasks

S Gururangan, A Marasović, S Swayamdipta… - arxiv preprint arxiv …, 2020 - arxiv.org
Language models pretrained on text from a wide variety of sources form the foundation of
today's NLP. In light of the success of these broad-coverage models, we investigate whether …

Relational graph attention network for aspect-based sentiment analysis

K Wang, W Shen, Y Yang, X Quan, R Wang - arxiv preprint arxiv …, 2020 - arxiv.org
Aspect-based sentiment analysis aims to determine the sentiment polarity towards a specific
aspect in online reviews. Most recent efforts adopt attention-based neural network models to …

Investigating ChatGPT and cybersecurity: A perspective on topic modeling and sentiment analysis

OD Okey, EU Udo, RL Rosa, DZ Rodríguez… - Computers & …, 2023 - Elsevier
Abstract In early 2023, the Artificial Intelligence (AI) industry experienced a significant
advancement with the emergence of OpenAI's ChatGPT, a research product that …

State of the art: a review of sentiment analysis based on sequential transfer learning

JYL Chan, KT Bea, SMH Leow, SW Phoong… - Artificial Intelligence …, 2023 - Springer
Recently, sequential transfer learning emerged as a modern technique for applying the
“pretrain then fine-tune” paradigm to leverage existing knowledge to improve the …

Aspect-category-opinion-sentiment quadruple extraction with implicit aspects and opinions

H Cai, R **a, J Yu - Proceedings of the 59th annual meeting of the …, 2021 - aclanthology.org
Product reviews contain a large number of implicit aspects and implicit opinions. However,
most of the existing studies in aspect-based sentiment analysis ignored this problem. In this …