A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

A comprehensive study of class incremental learning algorithms for visual tasks

E Belouadah, A Popescu, I Kanellos - Neural Networks, 2021 - Elsevier
The ability of artificial agents to increment their capabilities when confronted with new data is
an open challenge in artificial intelligence. The main challenge faced in such cases is …

Three types of incremental learning

GM Van de Ven, T Tuytelaars, AS Tolias - Nature Machine Intelligence, 2022 - nature.com
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …

Rainbow memory: Continual learning with a memory of diverse samples

J Bang, H Kim, YJ Yoo, JW Ha… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Continual learning is a realistic learning scenario for AI models. Prevalent scenario of
continual learning, however, assumes disjoint sets of classes as tasks and is less realistic …

Constrained few-shot class-incremental learning

M Hersche, G Karunaratne… - Proceedings of the …, 2022 - openaccess.thecvf.com
Continually learning new classes from fresh data without forgetting previous knowledge of
old classes is a very challenging research problem. Moreover, it is imperative that such …

Distilling causal effect of data in class-incremental learning

X Hu, K Tang, C Miao, XS Hua… - Proceedings of the …, 2021 - openaccess.thecvf.com
We propose a causal framework to explain the catastrophic forgetting in Class-Incremental
Learning (CIL) and then derive a novel distillation method that is orthogonal to the existing …

Always be dreaming: A new approach for data-free class-incremental learning

J Smith, YC Hsu, J Balloch, Y Shen… - Proceedings of the …, 2021 - openaccess.thecvf.com
Modern computer vision applications suffer from catastrophic forgetting when incrementally
learning new concepts over time. The most successful approaches to alleviate this forgetting …

A model or 603 exemplars: Towards memory-efficient class-incremental learning

DW Zhou, QW Wang, HJ Ye, DC Zhan - arxiv preprint arxiv:2205.13218, 2022 - arxiv.org
Real-world applications require the classification model to adapt to new classes without
forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a …

Few-shot class-incremental learning via entropy-regularized data-free replay

H Liu, L Gu, Z Chi, Y Wang, Y Yu, J Chen… - European Conference on …, 2022 - Springer
Few-shot class-incremental learning (FSCIL) has been proposed aiming to enable a deep
learning system to incrementally learn new classes with limited data. Recently, a pioneer …

Synthesizing informative training samples with gan

B Zhao, H Bilen - arxiv preprint arxiv:2204.07513, 2022 - arxiv.org
Remarkable progress has been achieved in synthesizing photo-realistic images with
generative adversarial networks (GANs). Recently, GANs are utilized as the training sample …