A comprehensive survey of continual learning: Theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Recent advances of continual learning in computer vision: An overview

H Qu, H Rahmani, L Xu, B Williams, J Liu - arxiv preprint arxiv …, 2021 - arxiv.org
In contrast to batch learning where all training data is available at once, continual learning
represents a family of methods that accumulate knowledge and learn continuously with data …

[PDF][PDF] Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - arxiv preprint arxiv …, 2023 - researchgate.net
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Ranpac: Random projections and pre-trained models for continual learning

MD McDonnell, D Gong, A Parvaneh… - Advances in …, 2023 - proceedings.neurips.cc
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …

Co2l: Contrastive continual learning

H Cha, J Lee, J Shin - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Recent breakthroughs in self-supervised learning show that such algorithms learn visual
representations that can be transferred better to unseen tasks than cross-entropy based …

Online continual learning through mutual information maximization

Y Guo, B Liu, D Zhao - International conference on machine …, 2022 - proceedings.mlr.press
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …

Pcr: Proxy-based contrastive replay for online class-incremental continual learning

H Lin, B Zhang, S Feng, X Li… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Online class-incremental continual learning is a specific task of continual learning. It aims to
continuously learn new classes from data stream and the samples of data stream are seen …

Computationally budgeted continual learning: What does matter?

A Prabhu, HA Al Kader Hammoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual Learning (CL) aims to sequentially train models on streams of incoming data that
vary in distribution by preserving previous knowledge while adapting to new data. Current …

New insights on reducing abrupt representation change in online continual learning

L Caccia, R Aljundi, N Asadi, T Tuytelaars… - arxiv preprint arxiv …, 2021 - arxiv.org
In the online continual learning paradigm, agents must learn from a changing distribution
while respecting memory and compute constraints. Experience Replay (ER), where a small …

Online prototype learning for online continual learning

Y Wei, J Ye, Z Huang, J Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Online continual learning (CL) studies the problem of learning continuously from a single-
pass data stream while adapting to new data and mitigating catastrophic forgetting …