Hierarchical decomposition of prompt-based continual learning: Rethinking obscured sub-optimality

L Wang, J **e, X Zhang, M Huang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Prompt-based continual learning is an emerging direction in leveraging pre-trained
knowledge for downstream continual learning, and has almost reached the performance …

Ranpac: Random projections and pre-trained models for continual learning

MD McDonnell, D Gong, A Parvaneh… - Advances in …, 2024 - proceedings.neurips.cc
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …

Semantic residual prompts for continual learning

M Menabue, E Frascaroli, M Boschini… - … on Computer Vision, 2024 - Springer
Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and
train a few parameter vectors termed prompts. Most of these methods organize these vectors …

Online continual learning without the storage constraint

A Prabhu, Z Cai, P Dokania, P Torr, V Koltun… - arxiv preprint arxiv …, 2023 - arxiv.org
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …

Continual learning with pre-trained models: A survey

DW Zhou, HL Sun, J Ning, HJ Ye, DC Zhan - arxiv preprint arxiv …, 2024 - arxiv.org
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …

Convolutional Prompting meets Language Models for Continual Learning

A Roy, R Moulick, VK Verma… - Proceedings of the …, 2024 - openaccess.thecvf.com
Continual Learning (CL) enables machine learning models to learn from continuously
shifting new training data in absence of data from old tasks. Recently pre-trained vision …

Prompt Customization for Continual Learning

Y Dai, X Hong, Y Wang, Z Ma, D Jiang… - IEEE Transactions on …, 2025 - ieeexplore.ieee.org
Contemporary continual learning approaches typically select prompts from a pool, which
function as supplementary inputs to a pre-trained model. However, this strategy is hindered …

Adaptive Rentention & Correction for Continual Learning

H Chen, M Goldblum, Z Wu, YG Jiang - arxiv preprint arxiv:2405.14318, 2024 - arxiv.org
Continual learning, also known as lifelong learning or incremental learning, refers to the
process by which a model learns from a stream of incoming data over time. A common …

Revisiting Prompt-based Methods in Class Incremental Learning

Z Tao, L Yu, H Yao, C Xu - openreview.net
In recent years, prompt-based methods have emerged as a promising direction for continual
learning, demonstrating impressive performance across various benchmarks. These …

TIPS: Two-Level Prompt for Rehearsal-free Continual Learning

Z Feng, L Peng, M Zhou, P KUANG, M Wu, K Dang… - openreview.net
Continual learning based on prompt tuning creates a key-value pool, where these key-value
pairs are called prompts. Prompts are retrieved using input images as queries and input into …