[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

No one knows what attention is

B Hommel, CS Chapman, P Cisek, HF Neyedli… - Attention, Perception, & …, 2019 - Springer
In this article, we challenge the usefulness of “attention” as a unitary construct and/or neural
system. We point out that the concept has too many meanings to justify a single term, and …

Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need

DW Zhou, ZW Cai, HJ Ye, DC Zhan, Z Liu - arxiv preprint arxiv …, 2023 - arxiv.org
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …

Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need

DW Zhou, ZW Cai, HJ Ye, DC Zhan, Z Liu - International Journal of …, 2024 - Springer
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

Online continual learning with maximal interfered retrieval

R Aljundi, E Belilovsky, T Tuytelaars… - Advances in neural …, 2019 - proceedings.neurips.cc
Continual learning, the setting where a learning agent is faced with a never-ending stream
of data, continues to be a great challenge for modern machine learning systems. In …

A model or 603 exemplars: Towards memory-efficient class-incremental learning

DW Zhou, QW Wang, HJ Ye, DC Zhan - arxiv preprint arxiv:2205.13218, 2022 - arxiv.org
Real-world applications require the classification model to adapt to new classes without
forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a …

Continual prototype evolution: Learning online from non-stationary data streams

M De Lange, T Tuytelaars - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Attaining prototypical features to represent class distributions is well established in
representation learning. However, learning prototypes online from streaming data proves a …

Resynthesizing behavior through phylogenetic refinement

P Cisek - Attention, Perception, & Psychophysics, 2019 - Springer
This article proposes that biologically plausible theories of behavior can be constructed by
following a method of “phylogenetic refinement,” whereby they are progressively elaborated …