A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A comprehensive overview and comparative analysis on deep learning models: CNN, RNN, LSTM, GRU

FM Shiri, T Perumal, N Mustapha… - arxiv preprint arxiv …, 2023 - arxiv.org
Deep learning (DL) has emerged as a powerful subset of machine learning (ML) and
artificial intelligence (AI), outperforming traditional ML methods, especially in handling …

A survey on text classification: From traditional to deep learning

Q Li, H Peng, J Li, C **a, R Yang, L Sun… - ACM Transactions on …, 2022 - dl.acm.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

[HTML][HTML] Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification

A Onan - Journal of King Saud University-Computer and …, 2022 - Elsevier
Sentiment analysis has been a well-studied research direction in computational linguistics.
Deep neural network models, including convolutional neural networks (CNN) and recurrent …

ABCDM: An attention-based bidirectional CNN-RNN deep model for sentiment analysis

ME Basiri, S Nemati, M Abdar, E Cambria… - Future Generation …, 2021 - Elsevier
Sentiment analysis has been a hot research topic in natural language processing and data
mining fields in the last decade. Recently, deep neural network (DNN) models are being …

Deep learning--based text classification: a comprehensive review

S Minaee, N Kalchbrenner, E Cambria… - ACM computing …, 2021 - dl.acm.org
Deep learning--based models have surpassed classical machine learning--based
approaches in various text classification tasks, including sentiment analysis, news …

Pre-trained models for natural language processing: A survey

X Qiu, T Sun, Y Xu, Y Shao, N Dai, X Huang - Science China …, 2020 - Springer
Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …

A survey on deep learning for human activity recognition

F Gu, MH Chung, M Chignell, S Valaee… - ACM Computing …, 2021 - dl.acm.org
Human activity recognition is a key to a lot of applications such as healthcare and smart
home. In this study, we provide a comprehensive survey on recent advances and challenges …

A complete process of text classification system using state‐of‐the‐art NLP models

V Dogra, S Verma, Kavita, P Chatterjee… - Computational …, 2022 - Wiley Online Library
With the rapid advancement of information technology, online information has been
exponentially growing day by day, especially in the form of text documents such as news …

A review of recurrent neural networks: LSTM cells and network architectures

Y Yu, X Si, C Hu, J Zhang - Neural computation, 2019 - direct.mit.edu
Recurrent neural networks (RNNs) have been widely adopted in research areas concerned
with sequential data, such as text, audio, and video. However, RNNs consisting of sigma …