[HTML][HTML] Deep learning, reinforcement learning, and world models

Y Matsuo, Y LeCun, M Sahani, D Precup, D Silver… - Neural Networks, 2022 - Elsevier
Deep learning (DL) and reinforcement learning (RL) methods seem to be a part of
indispensable factors to achieve human-level or super-human AI systems. On the other …

Explaining dopamine through prediction errors and beyond

SJ Gershman, JA Assad, SR Datta, SW Linderman… - Nature …, 2024 - nature.com
The most influential account of phasic dopamine holds that it reports reward prediction
errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form …

Attractor and integrator networks in the brain

M Khona, IR Fiete - Nature Reviews Neuroscience, 2022 - nature.com
In this Review, we describe the singular success of attractor neural network models in
describing how the brain maintains persistent activity states for working memory, corrects …

How to build a cognitive map

JCR Whittington, D McCaffary, JJW Bakermans… - Nature …, 2022 - nature.com
Learning and interpreting the structure of the environment is an innate feature of biological
systems, and is integral to guiding flexible behaviors for evolutionary viability. The concept of …

Toroidal topology of population activity in grid cells

RJ Gardner, E Hermansen, M Pachitariu, Y Burak… - Nature, 2022 - nature.com
The medial entorhinal cortex is part of a neural system for map** the position of an
individual within a physical environment. Grid cells, a key component of this system, fire in a …

Geometry of abstract learned knowledge in the hippocampus

EH Nieh, M Schottdorf, NW Freeman, RJ Low… - Nature, 2021 - nature.com
Hippocampal neurons encode physical variables,,,,,–such as space or auditory frequency in
cognitive maps. In addition, functional magnetic resonance imaging studies in humans have …

Synaptic plasticity forms and functions

JC Magee, C Grienberger - Annual review of neuroscience, 2020 - annualreviews.org
Synaptic plasticity, the activity-dependent change in neuronal connection strength, has long
been considered an important component of learning and memory. Computational and …

All-optical physiology resolves a synaptic basis for behavioral timescale plasticity

LZ Fan, DK Kim, JH Jennings, H Tian, PY Wang… - Cell, 2023 - cell.com
Learning has been associated with modifications of synaptic and circuit properties, but the
precise changes storing information in mammals have remained largely unclear. We …

The Tolman-Eichenbaum machine: unifying space and relational memory through generalization in the hippocampal formation

JCR Whittington, TH Muller, S Mark, G Chen, C Barry… - Cell, 2020 - cell.com
The hippocampal-entorhinal system is important for spatial and relational memory tasks. We
formally link these domains, provide a mechanistic understanding of the hippocampal role in …

Model-based reinforcement learning: A survey

TM Moerland, J Broekens, A Plaat… - … and Trends® in …, 2023 - nowpublishers.com
Sequential decision making, commonly formalized as Markov Decision Process (MDP)
optimization, is an important challenge in artificial intelligence. Two key approaches to this …