Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

A comprehensive review of data‐driven co‐speech gesture generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

Sequential modeling enables scalable learning for large vision models

Y Bai, X Geng, K Mangalam, A Bar… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce a novel sequential modeling approach which enables learning a Large Vision
Model (LVM) without making use of any linguistic data. To do this we define a common …

Human motion diffusion as a generative prior

Y Shafir, G Tevet, R Kapon, AH Bermano - arxiv preprint arxiv:2303.01418, 2023 - arxiv.org
Recent work has demonstrated the significant potential of denoising diffusion models for
generating human motion, including text-to-motion capabilities. However, these methods are …

Bailando: 3d dance generation by actor-critic gpt with choreographic memory

L Siyao, W Yu, T Gu, C Lin, Q Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Driving 3D characters to dance following a piece of music is highly challenging due to the
spatial constraints applied to poses by choreography norms. In addition, the generated …

Humor: 3d human motion model for robust pose estimation

D Rempe, T Birdal, A Hertzmann… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose
and shape. Though substantial progress has been made in estimating 3D human motion …

Tmr: Text-to-motion retrieval using contrastive 3d human motion synthesis

M Petrovich, MJ Black, G Varol - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
In this paper, we present TMR, a simple yet effective approach for text to 3D human motion
retrieval. While previous work has only treated retrieval as a proxy evaluation metric, we …

Ai choreographer: Music conditioned 3d dance generation with aist++

R Li, S Yang, DA Ross… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present AIST++, a new multi-modal dataset of 3D dance motion and music, along with
FACT, a Full-Attention Cross-modal Transformer network for generating 3D dance motion …

Deepphase: Periodic autoencoders for learning motion phase manifolds

S Starke, I Mason, T Komura - ACM Transactions on Graphics (ToG), 2022 - dl.acm.org
Learning the spatial-temporal structure of body movements is a fundamental problem for
character motion synthesis. In this work, we propose a novel neural network architecture …

Rhythmic gesticulator: Rhythm-aware co-speech gesture synthesis with hierarchical neural embeddings

T Ao, Q Gao, Y Lou, B Chen, L Liu - ACM Transactions on Graphics …, 2022 - dl.acm.org
Automatic synthesis of realistic co-speech gestures is an increasingly important yet
challenging task in artificial embodied agent creation. Previous systems mainly focus on …