[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

An appraisal of incremental learning methods

Y Luo, L Yin, W Bai, K Mao - Entropy, 2020 - mdpi.com
As a special case of machine learning, incremental learning can acquire useful knowledge
from incoming data continuously while it does not need to access the original data. It is …

A dynamic ensemble learning algorithm for neural networks

KMR Alam, N Siddique, H Adeli - Neural Computing and Applications, 2020 - Springer
This paper presents a novel dynamic ensemble learning (DEL) algorithm for designing
ensemble of neural networks (NNs). DEL algorithm determines the size of ensemble, the …

Measuring catastrophic forgetting in neural networks

R Kemker, M McClure, A Abitino, T Hayes… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Deep neural networks are used in many state-of-the-art systems for machine perception.
Once a network is trained to do a specific task, eg, bird classification, it cannot easily be …

Neuzz: Efficient fuzzing with neural program smoothing

D She, K Pei, D Epstein, J Yang… - 2019 IEEE Symposium …, 2019 - ieeexplore.ieee.org
Fuzzing has become the de facto standard technique for finding software vulnerabilities.
However, even state-of-the-art fuzzers are not very efficient at finding hard-to-trigger …

Memory efficient experience replay for streaming learning

TL Hayes, ND Cahill, C Kanan - 2019 International Conference …, 2019 - ieeexplore.ieee.org
In supervised machine learning, an agent is typically trained once and then deployed. While
this works well for static settings, robots often operate in changing environments and must …

Task-free continual learning via online discrepancy distance learning

F Ye, AG Bors - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
Learning from non-stationary data streams, also called Task-Free Continual Learning
(TFCL) remains challenging due to the absence of explicit task information in most …

Learning latent representations across multiple data domains using lifelong VAEGAN

F Ye, AG Bors - European Conference on Computer Vision, 2020 - Springer
The problem of catastrophic forgetting occurs in deep learning models trained on multiple
databases in a sequential manner. Recently, generative replay mechanisms (GRM) have …

Lifelong teacher-student network learning

F Ye, AG Bors - IEEE Transactions on Pattern Analysis and …, 2021 - ieeexplore.ieee.org
A unique cognitive capability of humans consists in their ability to acquire new knowledge
and skills from a sequence of experiences. Meanwhile, artificial intelligence systems are …

Rodeo: Replay for online object detection

M Acharya, TL Hayes, C Kanan - arxiv preprint arxiv:2008.06439, 2020 - arxiv.org
Humans can incrementally learn to do new visual detection tasks, which is a huge challenge
for today's computer vision systems. Incrementally trained deep learning models lack …