Towards lifelong learning of large language models: A survey

J Zheng, S Qiu, C Shi, Q Ma - ACM Computing Surveys, 2024 - dl.acm.org
As the applications of large language models (LLMs) expand across diverse fields, their
ability to adapt to ongoing changes in data, tasks, and user preferences becomes crucial …

Continual learning of natural language processing tasks: A survey

Z Ke, B Liu - arxiv preprint arxiv:2211.12701, 2022 - arxiv.org
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …

Three types of incremental learning

GM Van de Ven, T Tuytelaars, AS Tolias - Nature Machine Intelligence, 2022 - nature.com
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …

A survey on aspect-based sentiment analysis: Tasks, methods, and challenges

W Zhang, X Li, Y Deng, L Bing… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
As an important fine-grained sentiment analysis problem, aspect-based sentiment analysis
(ABSA), aiming to analyze and understand people's opinions at the aspect level, has been …

Online continual learning through mutual information maximization

Y Guo, B Liu, D Zhao - International conference on machine …, 2022 - proceedings.mlr.press
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …

Achieving forgetting prevention and knowledge transfer in continual learning

Z Ke, B Liu, N Ma, H Xu, L Shu - Advances in Neural …, 2021 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving
two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge …

Recent advances of foundation language models-based continual learning: A survey

Y Yang, J Zhou, X Ding, T Huai, S Liu, Q Chen… - ACM Computing …, 2025 - dl.acm.org
Recently, foundation language models (LMs) have marked significant achievements in the
domains of natural language processing and computer vision. Unlike traditional neural …

Bns: Building network structures dynamically for continual learning

Q Qin, W Hu, H Peng, D Zhao… - Advances in Neural …, 2021 - proceedings.neurips.cc
Continual learning (CL) of a sequence of tasks is often accompanied with the catastrophic
forgetting (CF) problem. Existing research has achieved remarkable results in overcoming …

Towards retraining-free RNA modification prediction with incremental learning

J Qiao, J **, H Yu, L Wei - Information Sciences, 2024 - Elsevier
RNA modifications are important for deciphering the function of cells and their regulatory
mechanisms. In recent years, researchers have developed many deep learning methods to …

Incremental prompting: Episodic memory prompt for lifelong event detection

M Liu, S Chang, L Huang - arxiv preprint arxiv:2204.07275, 2022 - arxiv.org
Lifelong event detection aims to incrementally update a model with new event types and
data while retaining the capability on previously learned old types. One critical challenge is …