A comprehensive survey of continual learning: theory, method and application
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
Adaptive extreme edge computing for wearable devices
Wearable devices are a fast-growing technology with impact on personal healthcare for both
society and economy. Due to the widespread of sensors in pervasive and distributed …
society and economy. Due to the widespread of sensors in pervasive and distributed …
Laplace redux-effortless bayesian deep learning
Bayesian formulations of deep learning have been shown to have compelling theoretical
properties and offer practical functional benefits, such as improved predictive uncertainty …
properties and offer practical functional benefits, such as improved predictive uncertainty …
A continual learning survey: Defying forgetting in classification tasks
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …
acquiring knowledge through generalized learning behaviour from a distinct training phase …
Memory aware synapses: Learning what (not) to forget
Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten
by new incoming information while important, frequently used knowledge is prevented from …
by new incoming information while important, frequently used knowledge is prevented from …
Progress & compress: A scalable framework for continual learning
We introduce a conceptually simple and scalable framework for continual learning domains
where tasks are learned sequentially. Our method is constant in the number of parameters …
where tasks are learned sequentially. Our method is constant in the number of parameters …
Continual learning with hypernetworks
Artificial neural networks suffer from catastrophic forgetting when they are sequentially
trained on multiple tasks. To overcome this problem, we present a novel approach based on …
trained on multiple tasks. To overcome this problem, we present a novel approach based on …
Variational continual learning
This paper develops variational continual learning (VCL), a simple but general framework
for continual learning that fuses online variational inference (VI) and recent advances in …
for continual learning that fuses online variational inference (VI) and recent advances in …
Probing representation forgetting in supervised and unsupervised continual learning
Continual Learning (CL) research typically focuses on tackling the phenomenon of
catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an …
catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an …
Continuous learning in single-incremental-task scenarios
It was recently shown that architectural, regularization and rehearsal strategies can be used
to train deep models sequentially on a number of disjoint tasks without forgetting previously …
to train deep models sequentially on a number of disjoint tasks without forgetting previously …