A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need

DW Zhou, ZW Cai, HJ Ye, DC Zhan, Z Liu - arxiv preprint arxiv …, 2023 - arxiv.org
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Fecam: Exploiting the heterogeneity of class distributions in exemplar-free continual learning

D Goswami, Y Liu, B Twardowski… - Advances in Neural …, 2024 - proceedings.neurips.cc
Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits
the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting …

Tangent model composition for ensembling and continual fine-tuning

TY Liu, S Soatto - … of the IEEE/CVF International Conference …, 2023 - openaccess.thecvf.com
Abstract Tangent Model Composition (TMC) is a method to combine component models
independently fine-tuned around a pre-trained point. Component models are tangent …

Icicle: Interpretable class incremental continual learning

D Rymarczyk, J van de Weijer… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual learning enables incremental learning of new tasks without forgetting those
previously learned, resulting in positive knowledge transfer that can enhance performance …

Magmax: Leveraging model merging for seamless continual learning

D Marczak, B Twardowski, T Trzciński… - European Conference on …, 2024 - Springer
This paper introduces a continual learning approach named MagMax, which utilizes model
merging to enable large pre-trained models to continuously learn from new data without …

Catastrophic forgetting in deep learning: A comprehensive taxonomy

EL Aleixo, JG Colonna, M Cristo… - arxiv preprint arxiv …, 2023 - arxiv.org
Deep Learning models have achieved remarkable performance in tasks such as image
classification or generation, often surpassing human accuracy. However, they can struggle …

Diffclass: Diffusion-based class incremental learning

Z Meng, J Zhang, C Yang, Z Zhan, P Zhao… - European Conference on …, 2024 - Springer
Abstract Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On
top of that, exemplar-free CIL is even more challenging due to forbidden access to data of …

Towards realistic evaluation of industrial continual learning scenarios with an emphasis on energy consumption and computational footprint

V Chavan, P Koch, M Schlüter… - Proceedings of the …, 2023 - openaccess.thecvf.com
Incremental Learning (IL) aims to develop Machine Learning (ML) models that can learn
from continuous streams of data and mitigate catastrophic forgetting. We analyse the current …