Replay in deep learning: Current approaches and missing biological elements

TL Hayes, GP Krishnan, M Bazhenov… - Neural …, 2021 - ieeexplore.ieee.org
Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …

An appraisal of incremental learning methods

Y Luo, L Yin, W Bai, K Mao - Entropy, 2020 - mdpi.com
As a special case of machine learning, incremental learning can acquire useful knowledge
from incoming data continuously while it does not need to access the original data. It is …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

An efficient domain-incremental learning approach to drive in all weather conditions

MJ Mirza, M Masana, H Possegger… - Proceedings of the …, 2022 - openaccess.thecvf.com
Although deep neural networks enable impressive visual perception performance for
autonomous driving, their robustness to varying weather conditions still requires attention …

Generative replay with feedback connections as a general strategy for continual learning

GM Van de Ven, AS Tolias - ar** artificial intelligence applications capable of true lifelong
learning is that artificial neural networks quickly or catastrophically forget previously learned …

Model behavior preserving for class-incremental learning

Y Liu, X Hong, X Tao, S Dong, J Shi… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Deep models have shown to be vulnerable to catastrophic forgetting, a phenomenon that
the recognition performance on old data degrades when a pre-trained model is fine-tuned …

Continual sequence generation with adaptive compositional modules

Y Zhang, X Wang, D Yang - arxiv preprint arxiv:2203.10652, 2022 - arxiv.org
Continual learning is essential for real-world deployment when there is a need to quickly
adapt the model to new tasks without forgetting knowledge of old tasks. Existing work on …

Looking back on learned experiences for class/task incremental learning

M PourKeshavarzi, G Zhao… - … Conference on Learning …, 2021 - openreview.net
Classical deep neural networks are limited in their ability to learn from emerging streams of
training data. When trained sequentially on new or evolving tasks, their performance …

LIQA: Lifelong blind image quality assessment

J Liu, W Zhou, X Li, J Xu, Z Chen - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The image distortions are complex and dynamically changing in the real-world scenario,
due to the fast development of the image processing system. The blind image quality …

Cfa: Constraint-based finetuning approach for generalized few-shot object detection

K Guirguis, A Hendawy, G Eskandar… - Proceedings of the …, 2022 - openaccess.thecvf.com
Few-shot object detection (FSOD) seeks to detect novel categories with limited data by
leveraging prior knowledge from abundant base data. Generalized few-shot object detection …