A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Adaptive extreme edge computing for wearable devices

E Covi, E Donati, X Liang, D Kappel… - Frontiers in …, 2021 - frontiersin.org
Wearable devices are a fast-growing technology with impact on personal healthcare for both
society and economy. Due to the widespread of sensors in pervasive and distributed …

Laplace redux-effortless bayesian deep learning

E Daxberger, A Kristiadi, A Immer… - Advances in …, 2021 - proceedings.neurips.cc
Bayesian formulations of deep learning have been shown to have compelling theoretical
properties and offer practical functional benefits, such as improved predictive uncertainty …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

Memory aware synapses: Learning what (not) to forget

R Aljundi, F Babiloni, M Elhoseiny… - Proceedings of the …, 2018 - openaccess.thecvf.com
Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten
by new incoming information while important, frequently used knowledge is prevented from …

Progress & compress: A scalable framework for continual learning

J Schwarz, W Czarnecki, J Luketina… - International …, 2018 - proceedings.mlr.press
We introduce a conceptually simple and scalable framework for continual learning domains
where tasks are learned sequentially. Our method is constant in the number of parameters …

Continual learning with hypernetworks

J Von Oswald, C Henning, BF Grewe… - arxiv preprint arxiv …, 2019 - arxiv.org
Artificial neural networks suffer from catastrophic forgetting when they are sequentially
trained on multiple tasks. To overcome this problem, we present a novel approach based on …

Variational continual learning

CV Nguyen, Y Li, TD Bui, RE Turner - arxiv preprint arxiv:1710.10628, 2017 - arxiv.org
This paper develops variational continual learning (VCL), a simple but general framework
for continual learning that fuses online variational inference (VI) and recent advances in …

Probing representation forgetting in supervised and unsupervised continual learning

MR Davari, N Asadi, S Mudur… - Proceedings of the …, 2022 - openaccess.thecvf.com
Continual Learning (CL) research typically focuses on tackling the phenomenon of
catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an …

Continuous learning in single-incremental-task scenarios

D Maltoni, V Lomonaco - Neural Networks, 2019 - Elsevier
It was recently shown that architectural, regularization and rehearsal strategies can be used
to train deep models sequentially on a number of disjoint tasks without forgetting previously …