How learning unfolds in the brain: toward an optimization view
How do changes in the brain lead to learning? To answer this question, consider an artificial
neural network (ANN), where learning proceeds by optimizing a given objective or cost …
neural network (ANN), where learning proceeds by optimizing a given objective or cost …
Mice alternate between discrete strategies during perceptual decision-making
Classical models of perceptual decision-making assume that subjects use a single,
consistent strategy to form decisions, or that decision-making strategies evolve slowly over …
consistent strategy to form decisions, or that decision-making strategies evolve slowly over …
[HTML][HTML] Extracting the dynamics of behavior in sensory decision-making experiments
Decision-making strategies evolve during training and can continue to vary even in well-
trained animals. However, studies of sensory decision-making tend to characterize behavior …
trained animals. However, studies of sensory decision-making tend to characterize behavior …
Emergent behaviour and neural dynamics in artificial agents tracking odour plumes
Tracking an odour plume to locate its source under variable wind and plume statistics is a
complex task. Flying insects routinely accomplish such tracking, often over long distances, in …
complex task. Flying insects routinely accomplish such tracking, often over long distances, in …
Mice exhibit stochastic and efficient action switching during probabilistic decision making
CC Beron, SQ Neufeld… - Proceedings of the …, 2022 - National Acad Sciences
In probabilistic and nonstationary environments, individuals must use internal and external
cues to flexibly make decisions that lead to desirable outcomes. To gain insight into the …
cues to flexibly make decisions that lead to desirable outcomes. To gain insight into the …
Reinforcement learning with non-exponential discounting
M Schultheis, CA Rothkopf… - Advances in neural …, 2022 - proceedings.neurips.cc
Commonly in reinforcement learning (RL), rewards are discounted over time using an
exponential function to model time preference, thereby bounding the expected long-term …
exponential function to model time preference, thereby bounding the expected long-term …
Harnessing the flexibility of neural networks to predict dynamic theoretical parameters underlying human choice behavior
Reinforcement learning (RL) models are used extensively to study human behavior. These
rely on normative models of behavior and stress interpretability over predictive capabilities …
rely on normative models of behavior and stress interpretability over predictive capabilities …
[PDF][PDF] Curriculum learning as a tool to uncover learning principles in the brain
We present a novel approach to use curricula to identify principles by which a system learns.
Previous work in curriculum learning has focused on how curricula can be designed to …
Previous work in curriculum learning has focused on how curricula can be designed to …
Reward expectations direct learning and drive operant matching in Drosophila
AE Rajagopalan, R Darshan… - Proceedings of the …, 2023 - National Acad Sciences
Foraging animals must use decision-making strategies that dynamically adapt to the
changing availability of rewards in the environment. A wide diversity of animals do this by …
changing availability of rewards in the environment. A wide diversity of animals do this by …
Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules
To unveil how the brain learns, ongoing work seeks biologically-plausible approximations of
gradient descent algorithms for training recurrent neural networks (RNNs). Yet, beyond task …
gradient descent algorithms for training recurrent neural networks (RNNs). Yet, beyond task …