A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual detection transformer for incremental object detection

Y Liu, B Schiele, A Vedaldi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Incremental object detection (IOD) aims to train an object detector in phases, each with
annotations for new object categories. As other incremental settings, IOD is subject to …

A model or 603 exemplars: Towards memory-efficient class-incremental learning

DW Zhou, QW Wang, HJ Ye, DC Zhan - arxiv preprint arxiv:2205.13218, 2022 - arxiv.org
Real-world applications require the classification model to adapt to new classes without
forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a …

Continual semantic segmentation with automatic memory sample selection

L Zhu, T Chen, J Yin, S See… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract Continual Semantic Segmentation (CSS) extends static semantic segmentation by
incrementally introducing new classes for training. To alleviate the catastrophic forgetting …

Online hyperparameter optimization for class-incremental learning

Y Liu, Y Li, B Schiele, Q Sun - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Class-incremental learning (CIL) aims to train a classification model while the number of
classes increases phase-by-phase. An inherent challenge of CIL is the stability-plasticity …

Task-free continual learning via online discrepancy distance learning

F Ye, AG Bors - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
Learning from non-stationary data streams, also called Task-Free Continual Learning
(TFCL) remains challenging due to the absence of explicit task information in most …

Catastrophic forgetting in deep learning: A comprehensive taxonomy

EL Aleixo, JG Colonna, M Cristo… - arxiv preprint arxiv …, 2023 - arxiv.org
Deep Learning models have achieved remarkable performance in tasks such as image
classification or generation, often surpassing human accuracy. However, they can struggle …

Select and distill: Selective dual-teacher knowledge transfer for continual learning on vision-language models

YC Yu, CP Huang, JJ Chen, KP Chang, YH Lai… - … on Computer Vision, 2024 - Springer
Large-scale vision-language models (VLMs) have shown a strong zero-shot generalization
capability on unseen-domain data. However, adapting pre-trained VLMs to a sequence of …

Distributionally robust memory evolution with generalized divergence for continual learning

Z Wang, L Shen, T Duan, Q Suo, L Fang… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Continual learning (CL) aims to learn a non-stationary data distribution and not forget
previous knowledge. The effectiveness of existing approaches that rely on memory replay …

Enhancing knowledge transfer for task incremental learning with data-free subnetwork

Q Gao, X Shan, Y Zhang… - Advances in Neural …, 2023 - proceedings.neurips.cc
As there exist competitive subnetworks within a dense network in concert with Lottery Ticket
Hypothesis, we introduce a novel neuron-wise task incremental learning method, namely …