Hierarchical decomposition of prompt-based continual learning: Rethinking obscured sub-optimality
Prompt-based continual learning is an emerging direction in leveraging pre-trained
knowledge for downstream continual learning, and has almost reached the performance …
knowledge for downstream continual learning, and has almost reached the performance …
Ranpac: Random projections and pre-trained models for continual learning
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …
Semantic residual prompts for continual learning
Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and
train a few parameter vectors termed prompts. Most of these methods organize these vectors …
train a few parameter vectors termed prompts. Most of these methods organize these vectors …
Online continual learning without the storage constraint
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
Continual learning with pre-trained models: A survey
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …
Convolutional Prompting meets Language Models for Continual Learning
Continual Learning (CL) enables machine learning models to learn from continuously
shifting new training data in absence of data from old tasks. Recently pre-trained vision …
shifting new training data in absence of data from old tasks. Recently pre-trained vision …
Prompt Customization for Continual Learning
Contemporary continual learning approaches typically select prompts from a pool, which
function as supplementary inputs to a pre-trained model. However, this strategy is hindered …
function as supplementary inputs to a pre-trained model. However, this strategy is hindered …
Adaptive Rentention & Correction for Continual Learning
Continual learning, also known as lifelong learning or incremental learning, refers to the
process by which a model learns from a stream of incoming data over time. A common …
process by which a model learns from a stream of incoming data over time. A common …
TIPS: Two-Level Prompt for Rehearsal-free Continual Learning
Z Feng, L Peng, M Zhou, P KUANG, M Wu, K Dang… - openreview.net
Continual learning based on prompt tuning creates a key-value pool, where these key-value
pairs are called prompts. Prompts are retrieved using input images as queries and input into …
pairs are called prompts. Prompts are retrieved using input images as queries and input into …