A brief overview of ChatGPT: The history, status quo and potential future development
ChatGPT, an artificial intelligence generated content (AIGC) model developed by OpenAI,
has attracted world-wide attention for its capability of dealing with challenging language …
has attracted world-wide attention for its capability of dealing with challenging language …
A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
[HTML][HTML] Pre-trained language models and their applications
Pre-trained language models have achieved striking success in natural language
processing (NLP), leading to a paradigm shift from supervised learning to pre-training …
processing (NLP), leading to a paradigm shift from supervised learning to pre-training …
Convit: Improving vision transformers with soft convolutional inductive biases
Convolutional architectures have proven extremely successful for vision tasks. Their hard
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …
Asleep at the keyboard? assessing the security of github copilot's code contributions
There is burgeoning interest in designing AI-based systems to assist humans in designing
computing systems, including tools that automatically generate computer code. The most …
computing systems, including tools that automatically generate computer code. The most …
Generative adversarial networks: A survey toward private and secure applications
Generative Adversarial Networks (GANs) have promoted a variety of applications in
computer vision and natural language processing, among others, due to its generative …
computer vision and natural language processing, among others, due to its generative …
Transformer models for text-based emotion detection: a review of BERT-based approaches
We cannot overemphasize the essence of contextual information in most natural language
processing (NLP) applications. The extraction of context yields significant improvements in …
processing (NLP) applications. The extraction of context yields significant improvements in …
Application of artificial intelligence in geotechnical engineering: A state-of-the-art review
Geotechnical engineering deals with soils and rocks and their use in engineering
constructions. By their nature, soils and rocks exhibit complex behaviours and a high level of …
constructions. By their nature, soils and rocks exhibit complex behaviours and a high level of …
Read like humans: Autonomous, bidirectional and iterative language modeling for scene text recognition
Linguistic knowledge is of great benefit to scene text recognition. However, how to effectively
model linguistic rules in end-to-end deep networks remains a research challenge. In this …
model linguistic rules in end-to-end deep networks remains a research challenge. In this …
End-to-end speech recognition: A survey
In the last decade of automatic speech recognition (ASR) research, the introduction of deep
learning has brought considerable reductions in word error rate of more than 50% relative …
learning has brought considerable reductions in word error rate of more than 50% relative …