Natural and robust walking using reinforcement learning without demonstrations in high-dimensional musculoskeletal models

P Schumacher, T Geijtenbeek, V Caggiano… - arxiv preprint arxiv …, 2023‏ - arxiv.org
Humans excel at robust bipedal walking in complex natural environments. In each step, they
adequately tune the interaction of biomechanical muscle dynamics and neuronal signals to …

MIMo: A Multimodal Infant Model for Studying Cognitive Development

D Mattern, P Schumacher, FM López… - … on Cognitive and …, 2024‏ - ieeexplore.ieee.org
Human intelligence and human consciousness emerge gradually during the process of
cognitive development. Understanding this development is an essential aspect of …

Investigating the impact of action representations in policy gradient algorithms

J Schneider, P Schumacher, D Häufle… - arxiv preprint arxiv …, 2023‏ - arxiv.org
Reinforcement learning~(RL) is a versatile framework for learning to solve complex real-
world tasks. However, influences on the learning performance of RL algorithms are often …

Motion learning for musculoskeletal robots based on cortex-inspired motor primitives and modulation

X Wang, J Chen, W Wu - IEEE Transactions on Cognitive and …, 2023‏ - ieeexplore.ieee.org
Musculoskeletal robots have structural advantages of flexibility, robustness, and compliance.
However, the control of such musculoskeletal robots is challenging. In particular, the …

Enhancing stance robustness and jump height in bipedal muscle-actuated systems: a bioinspired morphological development approach

N Badie, S Schmitt - Bioinspiration & Biomimetics, 2024‏ - iopscience.iop.org
Recognizing humans' unmatched robustness, adaptability, and learning abilities across
anthropomorphic movements compared to robots, we find inspiration in the simultaneous …

A physiologically enhanced muscle spindle model: using a Hill-type model for extrafusal fibers as template for intrafusal fibers

PFS Chacon, M Hammer, I Wochner… - Computer Methods in …, 2023‏ - Taylor & Francis
The muscle spindle is an essential proprioceptor, significantly involved in sensing limb
position and movement. Although biological spindle models exist for years, the gold …

ATARO: A Muscle-Driven Biorobotic Arm to Investigate Healthy and Impaired Motor Control

I Wochner, T Nadler, K Stollenmaier… - 2024 10th IEEE RAS …, 2024‏ - ieeexplore.ieee.org
Bio-inspired robotics have received increasing attention in recent years as the biological
neuro-muscular interplay achieves unprecedented robust, versatile, and safe movements …

Learning to Control Emulated Muscles in Real Robots: A Software Test Bed for Bio-Inspired Actuators in Hardware

P Schumacher, L Krause, J Schneider… - 2024 10th IEEE RAS …, 2024‏ - ieeexplore.ieee.org
Recent studies have demonstrated the immense potential of exploiting muscle actuator
morphology for natural and robust movement-in simulation. A validation on real robotic …

Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology

P Schumacher, L Krause, J Schneider… - arxiv preprint arxiv …, 2024‏ - arxiv.org
Recent studies have demonstrated the immense potential of exploiting muscle actuator
morphology for natural and robust movement--in simulation. A validation on real robotic …

Motion Control of High-Dimensional Musculoskeletal System with Hierarchical Model-Based Planning

Y Wei, S Zhuang, V Zhuang, Y Sui - The Thirteenth International …‏ - openreview.net
Controlling high-dimensional nonlinear systems presents significant challenges in biological
and robotic applications due to the large state and action spaces. While deep reinforcement …