Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Diffusion-based generation, optimization, and planning in 3d scenes

S Huang, Z Wang, P Li, B Jia, T Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce SceneDiffuser, a conditional generative model for 3D scene understanding.
SceneDiffuser provides a unified model for solving scene-conditioned generation …

Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Motion-x: A large-scale 3d expressive whole-body human motion dataset

J Lin, A Zeng, S Lu, Y Cai, R Zhang… - Advances in Neural …, 2023 - proceedings.neurips.cc
In this paper, we present Motion-X, a large-scale 3D expressive whole-body motion dataset.
Existing motion datasets predominantly contain body-only poses, lacking facial expressions …

Trace and pace: Controllable pedestrian animation via guided trajectory diffusion

D Rempe, Z Luo, X Bin Peng, Y Yuan… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce a method for generating realistic pedestrian trajectories and full-body
animations that can be controlled to meet user-defined goals. We draw on recent advances …

Object motion guided human motion synthesis

J Li, J Wu, CK Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
Modeling human behaviors in contextual environments has a wide range of applications in
character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans …

Scaling up dynamic human-scene interaction modeling

N Jiang, Z Zhang, H Li, X Ma, Z Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Confronting the challenges of data scarcity and advanced motion synthesis in human-scene
interaction modeling we introduce the TRUMANS dataset alongside a novel HSI motion …

Behave: Dataset and method for tracking human object interactions

BL Bhatnagar, X **e, IA Petrov… - Proceedings of the …, 2022 - openaccess.thecvf.com
Modelling interactions between humans and objects in natural environments is central to
many applications including gaming, virtual and mixed reality, as well as human behavior …

Teach: Temporal action composition for 3d humans

N Athanasiou, M Petrovich, MJ Black… - … Conference on 3D …, 2022 - ieeexplore.ieee.org
Given a series of natural language descriptions, our task is to generate 3D human motions
that correspond semantically to the text, and follow the temporal order of the instructions. In …

Move as you say interact as you can: Language-guided human motion generation with scene affordance

Z Wang, Y Chen, B Jia, P Li, J Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Despite significant advancements in text-to-motion synthesis generating language-guided
human motion within 3D environments poses substantial challenges. These challenges …