Reinforcement-learning in fronto-striatal circuits

B Averbeck, JP O'Doherty - Neuropsychopharmacology, 2022 - nature.com
We review the current state of knowledge on the computational and neural mechanisms of
reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the …

Hypothalamic interactions with large-scale neural circuits underlying reinforcement learning and motivated behavior

BB Averbeck, EA Murray - Trends in neurosciences, 2020 - cell.com
Biological agents adapt behavior to support the survival needs of the individual and the
species. In this review we outline the anatomical, physiological, and computational …

[HTML][HTML] Prefrontal cortex predicts state switches during reversal learning

R Bartolo, BB Averbeck - Neuron, 2020 - cell.com
Reinforcement learning allows organisms to predict future outcomes and to update their
beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates …

Orbitofrontal circuits control multiple reinforcement-learning processes

SM Groman, C Keistler, AJ Keip, E Hammarlund… - Neuron, 2019 - cell.com
Adaptive decision making in dynamic environments requires multiple reinforcement-learning
steps that may be implemented by dissociable neural circuits. Here, we used a novel …

Subcortical substrates of explore-exploit decisions in primates

VD Costa, AR Mitz, BB Averbeck - Neuron, 2019 - cell.com
The explore-exploit dilemma refers to the challenge of deciding when to forego immediate
rewards and explore new opportunities that could lead to greater rewards in the future …

Individuals with adverse childhood experiences explore less and underweight reward feedback

A Lloyd, RT McKay, N Furl - Proceedings of the National Academy of …, 2022 - pnas.org
Adverse childhood experiences (ACEs) are extreme stressors that lead to negative
psychosocial outcomes in adulthood. Nonhuman animals explore less after exposure to …

Trajectory smoothing method using reinforcement learning for computer numerical control machine tools

B Li, H Zhang, P Ye, J Wang - Robotics and Computer-Integrated …, 2020 - Elsevier
Tool-path codes output by computer-aided manufacturing software for high-speed
machining are composed of discontinuous G01 line segments. The discontinuity of these …

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses

H Tang, R Bartolo, BB Averbeck - Neuron, 2024 - cell.com
Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes.
However, it is usually studied with primary reinforcers. To examine the neural mechanisms …

Differential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior

H Tang, VD Costa, R Bartolo, BB Averbeck - Cell reports, 2022 - cell.com
Goal-directed behavior requires identifying objects in the environment that can satisfy
internal needs and executing actions to obtain those objects. The current study examines …

Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions

K Banaie Boroujeni, MK Sigona, RL Treuting… - PLoS …, 2022 - journals.plos.org
Anterior cingulate cortex (ACC) and striatum (STR) contain neurons encoding not only the
expected values of actions, but also the value of stimulus features irrespective of actions …