Towards continual reinforcement learning: A review and perspectives
In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …
[HTML][HTML] Brain-inspired learning in artificial neural networks: a review
Artificial neural networks (ANNs) have emerged as an essential tool in machine learning,
achieving remarkable success across diverse domains, including image and speech …
achieving remarkable success across diverse domains, including image and speech …
A survey of meta-reinforcement learning
While deep reinforcement learning (RL) has fueled multiple high-profile successes in
machine learning, it is held back from more widespread adoption by its often poor data …
machine learning, it is held back from more widespread adoption by its often poor data …
Structured state space models for in-context reinforcement learning
Structured state space sequence (S4) models have recently achieved state-of-the-art
performance on long-range sequence modeling tasks. These models also have fast …
performance on long-range sequence modeling tasks. These models also have fast …
General-purpose in-context learning by meta-learning transformers
Modern machine learning requires system designers to specify aspects of the learning
pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn …
pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn …
Discovering attention-based genetic algorithms via meta-black-box optimization
Genetic algorithms constitute a family of black-box optimization algorithms, which take
inspiration from the principles of biological evolution. While they provide a general-purpose …
inspiration from the principles of biological evolution. While they provide a general-purpose …
Discovering evolution strategies via meta-black-box optimization
Optimizing functions without access to gradients is the remit of black-box methods such as
evolution strategies. While highly general, their learning dynamics are often times heuristic …
evolution strategies. While highly general, their learning dynamics are often times heuristic …
On the effectiveness of fine-tuning versus meta-reinforcement learning
Intelligent agents should have the ability to leverage knowledge from previously learned
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …
Universal neural functionals
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …
features, ie, to transform or extract information from the weights and gradients of a neural …
On the effectiveness of fine-tuning versus meta-reinforcement learning
Intelligent agents should have the ability to leverage knowledge from previously learned
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …
tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have …