How to train your robot with deep reinforcement learning: lessons we have learned

J Ibarz, J Tan, C Finn, M Kalakrishnan… - … Journal of Robotics …, 2021 - journals.sagepub.com
Deep reinforcement learning (RL) has emerged as a promising approach for autonomously
acquiring complex behaviors from low-level sensor observations. Although a large portion of …

Deep reinforcement learning for modeling human locomotion control in neuromechanical simulation

S Song, Ł Kidziński, XB Peng, C Ong, J Hicks… - … of neuroengineering and …, 2021 - Springer
Modeling human motor control and predicting how humans will move in novel environments
is a grand scientific challenge. Researchers in the fields of biomechanics and motor control …

Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters

XB Peng, Y Guo, L Halper, S Levine… - ACM Transactions On …, 2022 - dl.acm.org
The incredible feats of athleticism demonstrated by humans are made possible in part by a
vast repertoire of general-purpose motor skills, acquired through years of practice and …

Learning quadrupedal locomotion over challenging terrain

J Lee, J Hwangbo, L Wellhausen, V Koltun, M Hutter - Science robotics, 2020 - science.org
Legged locomotion can extend the operational domain of robots to some of the most
challenging environments on Earth. However, conventional controllers for legged …

Amp: Adversarial motion priors for stylized physics-based character control

XB Peng, Z Ma, P Abbeel, S Levine… - ACM Transactions on …, 2021 - dl.acm.org
Synthesizing graceful and life-like behaviors for physically simulated characters has been a
fundamental challenge in computer animation. Data-driven methods that leverage motion …

Trace and pace: Controllable pedestrian animation via guided trajectory diffusion

D Rempe, Z Luo, X Bin Peng, Y Yuan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce a method for generating realistic pedestrian trajectories and full-body
animations that can be controlled to meet user-defined goals. We draw on recent advances …

Learning agile and dynamic motor skills for legged robots

J Hwangbo, J Lee, A Dosovitskiy, D Bellicoso… - Science Robotics, 2019 - science.org
Legged robots pose one of the greatest challenges in robotics. Dynamic and agile
maneuvers of animals cannot be imitated by existing methods that are crafted by humans. A …

Embodied intelligence via learning and evolution

A Gupta, S Savarese, S Ganguli, L Fei-Fei - Nature communications, 2021 - nature.com
The intertwined processes of learning and evolution in complex environmental niches have
resulted in a remarkable diversity of morphological forms. Moreover, many aspects of animal …

Character controllers using motion vaes

HY Ling, F Zinno, G Cheng… - ACM Transactions on …, 2020 - dl.acm.org
A fundamental problem in computer animation is that of realizing purposeful and realistic
human movement given a sufficiently-rich set of motion capture clips. We learn data-driven …

Scalable muscle-actuated human simulation and control

S Lee, M Park, K Lee, J Lee - ACM Transactions On Graphics (TOG), 2019 - dl.acm.org
Many anatomical factors, such as bone geometry and muscle condition, interact to affect
human movements. This work aims to build a comprehensive musculoskeletal model and its …