Towards lifelong learning of large language models: A survey
As the applications of large language models (LLMs) expand across diverse fields, their
ability to adapt to ongoing changes in data, tasks, and user preferences becomes crucial …
ability to adapt to ongoing changes in data, tasks, and user preferences becomes crucial …
Continual learning of natural language processing tasks: A survey
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …
learning and accumulating knowledge continually without forgetting the previously learned …
Three types of incremental learning
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …
'continual learning', is a key feature of natural intelligence, but a challenging problem for …
A survey on aspect-based sentiment analysis: Tasks, methods, and challenges
As an important fine-grained sentiment analysis problem, aspect-based sentiment analysis
(ABSA), aiming to analyze and understand people's opinions at the aspect level, has been …
(ABSA), aiming to analyze and understand people's opinions at the aspect level, has been …
Online continual learning through mutual information maximization
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …
Achieving forgetting prevention and knowledge transfer in continual learning
Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving
two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge …
two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge …
Recent advances of foundation language models-based continual learning: A survey
Recently, foundation language models (LMs) have marked significant achievements in the
domains of natural language processing and computer vision. Unlike traditional neural …
domains of natural language processing and computer vision. Unlike traditional neural …
Bns: Building network structures dynamically for continual learning
Continual learning (CL) of a sequence of tasks is often accompanied with the catastrophic
forgetting (CF) problem. Existing research has achieved remarkable results in overcoming …
forgetting (CF) problem. Existing research has achieved remarkable results in overcoming …
Towards retraining-free RNA modification prediction with incremental learning
RNA modifications are important for deciphering the function of cells and their regulatory
mechanisms. In recent years, researchers have developed many deep learning methods to …
mechanisms. In recent years, researchers have developed many deep learning methods to …
Incremental prompting: Episodic memory prompt for lifelong event detection
Lifelong event detection aims to incrementally update a model with new event types and
data while retaining the capability on previously learned old types. One critical challenge is …
data while retaining the capability on previously learned old types. One critical challenge is …