Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Generating human motion from textual descriptions with discrete representations

J Zhang, Y Zhang, X Cun, Y Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we investigate a simple and must-known conditional generative framework
based on Vector Quantised-Variational AutoEncoder (VQ-VAE) and Generative Pre-trained …

Remodiffuse: Retrieval-augmented motion diffusion model

M Zhang, X Guo, L Pan, Z Cai, F Hong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract 3D human motion generation is crucial for creative industry. Recent advances rely
on generative models with domain knowledge for text-driven motion generation, leading to …

Human motion diffusion as a generative prior

Y Shafir, G Tevet, R Kapon, AH Bermano - arxiv preprint arxiv:2303.01418, 2023 - arxiv.org
Recent work has demonstrated the significant potential of denoising diffusion models for
generating human motion, including text-to-motion capabilities. However, these methods are …

Dreamhuman: Animatable 3d avatars from text

N Kolotouros, T Alldieck, A Zanfir… - Advances in …, 2024 - proceedings.neurips.cc
Abstract We present\emph {DreamHuman}, a method to generate realistic animatable 3D
human avatar models entirely from textual descriptions. Recent text-to-3D methods have …

Motionlcm: Real-time controllable motion generation via latent consistency model

W Dai, LH Chen, J Wang, J Liu, B Dai… - European Conference on …, 2024 - Springer
This work introduces MotionLCM, extending controllable motion generation to a real-time
level. Existing methods for spatial-temporal control in text-conditioned motion generation …

Intergen: Diffusion-based multi-human motion generation under complex interactions

H Liang, W Zhang, W Li, J Yu, L Xu - International Journal of Computer …, 2024 - Springer
We have recently seen tremendous progress in diffusion advances for generating realistic
human motions. Yet, they largely disregard the multi-human interactions. In this paper, we …

TMR: Text-to-motion retrieval using contrastive 3D human motion synthesis

M Petrovich, MJ Black, G Varol - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
In this paper, we present TMR, a simple yet effective approach for text to 3D human motion
retrieval. While previous work has only treated retrieval as a proxy evaluation metric, we …

SINC: Spatial composition of 3D human motions for simultaneous action generation

N Athanasiou, M Petrovich… - Proceedings of the …, 2023 - openaccess.thecvf.com
Our goal is to synthesize 3D human motions given textual inputs describing simultaneous
actions, for examplewaving hand'whilewalking'at the same time. We refer to generating such …

Going beyond nouns with vision & language models using synthetic data

P Cascante-Bonilla, K Shehada… - Proceedings of the …, 2023 - openaccess.thecvf.com
Large-scale pre-trained Vision & Language (VL) models have shown remarkable
performance in many applications, enabling replacing a fixed set of supported classes with …