Generating diverse and natural 3d human motions from text

C Guo, S Zou, X Zuo, S Wang, W Ji… - Proceedings of the …, 2022 - openaccess.thecvf.com
Automated generation of 3D human motions from text is a challenging problem. The
generated motions are expected to be sufficiently diverse to explore the text-grounded …

Motionclip: Exposing human motion generation to clip space

G Tevet, B Gordon, A Hertz, AH Bermano… - … on Computer Vision, 2022 - Springer
We introduce MotionCLIP, a 3D human motion auto-encoder featuring a latent embedding
that is disentangled, well behaved, and supports highly semantic textual descriptions …

Synthesizing diverse human motions in 3d indoor scenes

K Zhao, Y Zhang, S Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a novel method for populating 3D indoor scenes with virtual humans that can
navigate in the environment and interact with objects in a realistic manner. Existing …

Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

Going beyond nouns with vision & language models using synthetic data

P Cascante-Bonilla, K Shehada… - Proceedings of the …, 2023 - openaccess.thecvf.com
Large-scale pre-trained Vision & Language (VL) models have shown remarkable
performance in many applications, enabling replacing a fixed set of supported classes with …

Omnicontrol: Control any joint at any time for human motion generation

Y **e, V Jampani, L Zhong, D Sun, H Jiang - arxiv preprint arxiv …, 2023 - arxiv.org
We present a novel approach named OmniControl for incorporating flexible spatial control
signals into a text-conditioned human motion generation model based on the diffusion …

Humantomato: Text-aligned whole-body motion generation

S Lu, LH Chen, A Zeng, J Lin, R Zhang, L Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
This work targets a novel text-driven whole-body motion generation task, which takes a
given textual description as input and aims at generating high-quality, diverse, and coherent …

Breaking the limits of text-conditioned 3d motion synthesis with elaborative descriptions

Y Qian, J Urbanek… - Proceedings of the …, 2023 - openaccess.thecvf.com
Given its wide applications, there is increasing focus on generating 3D human motions from
textual descriptions. Differing from the majority of previous works, which regard actions as …

Being comes from not-being: Open-vocabulary text-to-motion generation with wordless training

J Lin, J Chang, L Liu, G Li, L Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Text-to-motion generation is an emerging and challenging problem, which aims to
synthesize motion with the same semantics as the input text. However, due to the lack of …

Modi: Unconditional motion synthesis from diverse data

S Raab, I Leibovitch, P Li, K Aberman… - Proceedings of the …, 2023 - openaccess.thecvf.com
The emergence of neural networks has revolutionized the field of motion synthesis. Yet,
learning to unconditionally synthesize motions from a given distribution remains …