Towards continual reinforcement learning: A review and perspectives

K Khetarpal, M Riemer, I Rish, D Precup - Journal of Artificial Intelligence …, 2022 - jair.org
In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …

[HTML][HTML] Brain-inspired learning in artificial neural networks: a review

S Schmidgall, R Ziaei, J Achterberg, L Kirsch… - APL Machine …, 2024 - pubs.aip.org
Artificial neural networks (ANNs) have emerged as an essential tool in machine learning,
achieving remarkable success across diverse domains, including image and speech …

A survey of meta-reinforcement learning

J Beck, R Vuorio, EZ Liu, Z **ong, L Zintgraf… - arxiv preprint arxiv …, 2023 - arxiv.org
While deep reinforcement learning (RL) has fueled multiple high-profile successes in
machine learning, it is held back from more widespread adoption by its often poor data …

Structured state space models for in-context reinforcement learning

C Lu, Y Schroecker, A Gu, E Parisotto… - Advances in …, 2024 - proceedings.neurips.cc
Structured state space sequence (S4) models have recently achieved state-of-the-art
performance on long-range sequence modeling tasks. These models also have fast …

General-purpose in-context learning by meta-learning transformers

L Kirsch, J Harrison, J Sohl-Dickstein, L Metz - arxiv preprint arxiv …, 2022 - arxiv.org
Modern machine learning requires system designers to specify aspects of the learning
pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn …

Discovering attention-based genetic algorithms via meta-black-box optimization

R Lange, T Schaul, Y Chen, C Lu, T Zahavy… - Proceedings of the …, 2023 - dl.acm.org
Genetic algorithms constitute a family of black-box optimization algorithms, which take
inspiration from the principles of biological evolution. While they provide a general-purpose …

Discovering evolution strategies via meta-black-box optimization

R Lange, T Schaul, Y Chen, T Zahavy… - Proceedings of the …, 2023 - dl.acm.org
Optimizing functions without access to gradients is the remit of black-box methods such as
evolution strategies. While highly general, their learning dynamics are often times heuristic …

On the effectiveness of fine-tuning versus meta-reinforcement learning

Z Mandi, P Abbeel, S James - arxiv preprint arxiv:2206.03271, 2022 - arxiv.org
Intelligent agents should have the ability to leverage knowledge from previously learned
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …

Universal neural functionals

A Zhou, C Finn, J Harrison - arxiv preprint arxiv:2402.05232, 2024 - arxiv.org
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …

On the effectiveness of fine-tuning versus meta-reinforcement learning

M Zhao, P Abbeel, S James - Advances in neural …, 2022 - proceedings.neurips.cc
Intelligent agents should have the ability to leverage knowledge from previously learned
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …