Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective

MM Botvinick, Y Niv, AG Barto - cognition, 2009 - Elsevier
Research on human and animal behavior has long emphasized its hierarchical structure—
the divisibility of ongoing behavior into discrete tasks, which are comprised of subtask …

Foundation models for decision making: Problems, methods, and opportunities

S Yang, O Nachum, Y Du, J Wei, P Abbeel… - arxiv preprint arxiv …, 2023 - arxiv.org
Foundation models pretrained on diverse data at scale have demonstrated extraordinary
capabilities in a wide range of vision and language tasks. When such models are deployed …

[HTML][HTML] On the necessity of abstraction

G Konidaris - Current opinion in behavioral sciences, 2019 - Elsevier
A generally intelligent agent faces a dilemma: it requires a complex sensorimotor space to
be capable of solving a wide range of problems, but many tasks are only feasible given the …

Model-based reinforcement learning: A survey

TM Moerland, J Broekens, A Plaat… - … and Trends® in …, 2023 - nowpublishers.com
Sequential decision making, commonly formalized as Markov Decision Process (MDP)
optimization, is an important challenge in artificial intelligence. Two key approaches to this …

Data-efficient hierarchical reinforcement learning

O Nachum, SS Gu, H Lee… - Advances in neural …, 2018 - proceedings.neurips.cc
Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional
reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of …

Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation

TD Kulkarni, K Narasimhan, A Saeedi… - Advances in neural …, 2016 - proceedings.neurips.cc
Learning goal-directed behavior in environments with sparse feedback is a major challenge
for reinforcement learning algorithms. One of the key difficulties is insufficient exploration …

Representation matters: Offline pretraining for sequential decision making

M Yang, O Nachum - International Conference on Machine …, 2021 - proceedings.mlr.press
The recent success of supervised learning methods on ever larger offline datasets has
spurred interest in the reinforcement learning (RL) field to investigate whether the same …

Stochastic neural networks for hierarchical reinforcement learning

C Florensa, Y Duan, P Abbeel - arxiv preprint arxiv:1704.03012, 2017 - arxiv.org
Deep reinforcement learning has achieved many impressive results in recent years.
However, tasks with sparse rewards or long horizons continue to pose significant …

Language as an abstraction for hierarchical deep reinforcement learning

Y Jiang, SS Gu, KP Murphy… - Advances in Neural …, 2019 - proceedings.neurips.cc
Solving complex, temporally-extended tasks is a long-standing problem in reinforcement
learning (RL). We hypothesize that one critical element of solving such problems is the …

A laplacian framework for option discovery in reinforcement learning

MC Machado, MG Bellemare… - … on Machine Learning, 2017 - proceedings.mlr.press
Abstract Representation learning and option discovery are two of the biggest challenges in
reinforcement learning (RL). Proto-value functions (PVFs) are a well-known approach for …