Convolutional neural networks as a model of the visual system: Past, present, and future

GW Lindsay - Journal of cognitive neuroscience, 2021 - direct.mit.edu
Convolutional neural networks (CNNs) were inspired by early findings in the study of
biological vision. They have since become successful tools in computer vision and state-of …

Deep reinforcement learning and its neuroscientific implications

M Botvinick, JX Wang, W Dabney, KJ Miller… - Neuron, 2020 - cell.com
The emergence of powerful artificial intelligence (AI) is defining new research directions in
neuroscience. To date, this research has focused largely on deep neural networks trained …

Anymal parkour: Learning agile navigation for quadrupedal robots

D Hoeller, N Rudin, D Sako, M Hutter - Science Robotics, 2024 - science.org
Performing agile navigation with four-legged robots is a challenging task because of the
highly dynamic motions, contacts with various parts of the robot, and the limited field of view …

[HTML][HTML] dm_control: Software and tasks for continuous control

S Tunyasuvunakool, A Muldal, Y Doron, S Liu, S Bohez… - Software Impacts, 2020 - Elsevier
The dm_control software package is a collection of Python libraries and task suites for
reinforcement learning agents in an articulated-body simulation. Infrastructure includes a …

A virtual rodent predicts the structure of neural activity across behaviours

D Aldarondo, J Merel, JD Marshall, L Hasenclever… - Nature, 2024 - nature.com
Animals have exquisite control of their bodies, allowing them to perform a diverse range of
behaviours. How such control is implemented by the brain, however, remains unclear …

First return, then explore

A Ecoffet, J Huizinga, J Lehman, KO Stanley, J Clune - Nature, 2021 - nature.com
Reinforcement learning promises to solve complex sequential-decision problems
autonomously by specifying a high-level reward function only. However, reinforcement …

Critic regularized regression

Z Wang, A Novikov, K Zolna, JS Merel… - Advances in …, 2020 - proceedings.neurips.cc
Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy
optimization from large pre-recorded datasets without online environment interaction. It …

Deep hierarchical planning from pixels

D Hafner, KH Lee, I Fischer… - Advances in Neural …, 2022 - proceedings.neurips.cc
Intelligent agents need to select long sequences of actions to solve complex tasks. While
humans easily break down tasks into subgoals and reach them through millions of muscle …

Physics-based character controllers using conditional vaes

J Won, D Gopinath, J Hodgins - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
High-quality motion capture datasets are now publicly available, and researchers have used
them to create kinematics-based controllers that can generate plausible and diverse human …

Simpoe: Simulated character control for 3d human pose estimation

Y Yuan, SE Wei, T Simon, K Kitani… - Proceedings of the …, 2021 - openaccess.thecvf.com
Accurate estimation of 3D human motion from monocular video requires modeling both
kinematics (body motion without physical forces) and dynamics (motion with physical …