Learning-based legged locomotion: State of the art and future perspectives

S Ha, J Lee, M van de Panne, Z **e… - … Journal of Robotics …, 2024 - journals.sagepub.com
Legged locomotion holds the premise of universal mobility, a critical capability for many real-
world robotic applications. Both model-based and learning-based approaches have …

A survey on reinforcement learning methods in character animation

A Kwiatkowski, E Alvarado, V Kalogeiton… - Computer Graphics …, 2022 - Wiley Online Library
Reinforcement Learning is an area of Machine Learning focused on how agents can be
trained to make sequential decisions, and achieve a particular goal within an arbitrary …

Brax--a differentiable physics engine for large scale rigid body simulation

CD Freeman, E Frey, A Raichuk, S Girgin… - arxiv preprint arxiv …, 2021 - arxiv.org
We present Brax, an open source library for rigid body simulation with a focus on
performance and parallelism on accelerators, written in JAX. We present results on a suite of …

Human trajectory prediction via neural social physics

J Yue, D Manocha, H Wang - European conference on computer vision, 2022 - Springer
Trajectory prediction has been widely pursued in many fields, and many model-based and
model-free methods have been explored. The former include rule-based, geometric or …

Ppr: Physically plausible reconstruction from monocular videos

G Yang, S Yang, JZ Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Given monocular videos, we build 3D models of articulated objects and environments
whose 3D configurations satisfy dynamics and contact constraints. At its core, our method …

Controlvae: Model-based learning of generative controllers for physics-based characters

H Yao, Z Song, B Chen, L Liu - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
In this paper, we introduce ControlVAE, a novel model-based framework for learning
generative motion control policies based on variational autoencoders (VAE). Our framework …

Diff-lfd: Contact-aware model-based learning from visual demonstration for robotic manipulation via differentiable physics-based simulation and rendering

X Zhu, JH Ke, Z Xu, Z Sun, B Bai, J Lv… - … on Robot Learning, 2023 - proceedings.mlr.press
Abstract Learning from Demonstration (LfD) is an efficient technique for robots to acquire
new skills through expert observation, significantly mitigating the need for laborious manual …

Grasp'd: Differentiable contact-rich grasp synthesis for multi-fingered hands

D Turpin, L Wang, E Heiden, YC Chen… - … on Computer Vision, 2022 - Springer
The study of hand-object interaction requires generating viable grasp poses for high-
dimensional multi-finger models, often relying on analytic grasp synthesis which tends to …

Gradients are not all you need

L Metz, CD Freeman, SS Schoenholz… - arxiv preprint arxiv …, 2021 - arxiv.org
Differentiable programming techniques are widely used in the community and are
responsible for the machine learning renaissance of the past several decades. While these …

Global planning for contact-rich manipulation via local smoothing of quasi-dynamic contact models

T Pang, HJT Suh, L Yang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The empirical success of reinforcement learning (RL) in contact-rich manipulation leaves
much to be understood from a model-based perspective, where the key difficulties are often …