Listen, denoise, action! audio-driven motion synthesis with diffusion models

S Alexanderson, R Nagy, J Beskow… - ACM Transactions on …, 2023 - dl.acm.org
Diffusion models have experienced a surge of interest as highly expressive yet efficiently
trainable probabilistic models. We show that these models are an excellent fit for …

Ai choreographer: Music conditioned 3d dance generation with aist++

R Li, S Yang, DA Ross… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present AIST++, a new multi-modal dataset of 3D dance motion and music, along with
FACT, a Full-Attention Cross-modal Transformer network for generating 3D dance motion …

Amp: Adversarial motion priors for stylized physics-based character control

XB Peng, Z Ma, P Abbeel, S Levine… - ACM Transactions on …, 2021 - dl.acm.org
Synthesizing graceful and life-like behaviors for physically simulated characters has been a
fundamental challenge in computer animation. Data-driven methods that leverage motion …

Teach: Temporal action composition for 3d humans

N Athanasiou, M Petrovich, MJ Black… - … Conference on 3D …, 2022 - ieeexplore.ieee.org
Given a series of natural language descriptions, our task is to generate 3D human motions
that correspond semantically to the text, and follow the temporal order of the instructions. In …

Learning agile robotic locomotion skills by imitating animals

XB Peng, E Coumans, T Zhang, TW Lee, J Tan… - arxiv preprint arxiv …, 2020 - arxiv.org
Reproducing the diverse and agile locomotion skills of animals has been a longstanding
challenge in robotics. While manually-designed controllers have been able to emulate many …

Deepphase: Periodic autoencoders for learning motion phase manifolds

S Starke, I Mason, T Komura - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
Learning the spatial-temporal structure of body movements is a fundamental problem for
character motion synthesis. In this work, we propose a novel neural network architecture …

Advantage-weighted regression: Simple and scalable off-policy reinforcement learning

XB Peng, A Kumar, G Zhang, S Levine - arxiv preprint arxiv:1910.00177, 2019 - arxiv.org
In this paper, we aim to develop a simple and scalable reinforcement learning algorithm that
uses standard supervised learning methods as subroutines. Our goal is an algorithm that …

Hierarchical generation of human-object interactions with diffusion probabilistic models

H Pi, S Peng, M Yang, X Zhou… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper presents a novel approach to generating the 3D motion of a human interacting
with a target object, with a focus on solving the challenge of synthesizing long-range and …

Character controllers using motion vaes

HY Ling, F Zinno, G Cheng… - ACM Transactions on …, 2020 - dl.acm.org
A fundamental problem in computer animation is that of realizing purposeful and realistic
human movement given a sufficiently-rich set of motion capture clips. We learn data-driven …

Spatio-temporal gating-adjacency gcn for human motion prediction

C Zhong, L Hu, Z Zhang, Y Ye… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Predicting future motion based on historical motion sequence is a fundamental problem in
computer vision, and it has wide applications in autonomous driving and robotics. Some …