A comprehensive survey of continual learning: theory, method and application
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …
Class-incremental learning: A survey
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …
in many vision tasks in the closed world. However, novel classes emerge from time to time in …
Fecam: Exploiting the heterogeneity of class distributions in exemplar-free continual learning
Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits
the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting …
the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting …
Tangent model composition for ensembling and continual fine-tuning
Abstract Tangent Model Composition (TMC) is a method to combine component models
independently fine-tuned around a pre-trained point. Component models are tangent …
independently fine-tuned around a pre-trained point. Component models are tangent …
Icicle: Interpretable class incremental continual learning
Continual learning enables incremental learning of new tasks without forgetting those
previously learned, resulting in positive knowledge transfer that can enhance performance …
previously learned, resulting in positive knowledge transfer that can enhance performance …
Magmax: Leveraging model merging for seamless continual learning
This paper introduces a continual learning approach named MagMax, which utilizes model
merging to enable large pre-trained models to continuously learn from new data without …
merging to enable large pre-trained models to continuously learn from new data without …
Catastrophic forgetting in deep learning: A comprehensive taxonomy
Deep Learning models have achieved remarkable performance in tasks such as image
classification or generation, often surpassing human accuracy. However, they can struggle …
classification or generation, often surpassing human accuracy. However, they can struggle …
Diffclass: Diffusion-based class incremental learning
Abstract Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On
top of that, exemplar-free CIL is even more challenging due to forbidden access to data of …
top of that, exemplar-free CIL is even more challenging due to forbidden access to data of …
Towards realistic evaluation of industrial continual learning scenarios with an emphasis on energy consumption and computational footprint
Incremental Learning (IL) aims to develop Machine Learning (ML) models that can learn
from continuous streams of data and mitigate catastrophic forgetting. We analyse the current …
from continuous streams of data and mitigate catastrophic forgetting. We analyse the current …