Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Openscene: 3d scene understanding with open vocabularies

S Peng, K Genova, C Jiang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Traditional 3D scene understanding approaches rely on labeled 3D datasets to train a
model for a single task with supervision. We propose OpenScene, an alternative approach …

Diffusion-based generation, optimization, and planning in 3d scenes

S Huang, Z Wang, P Li, B Jia, T Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce SceneDiffuser, a conditional generative model for 3D scene understanding.
SceneDiffuser provides a unified model for solving scene-conditioned generation …

Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Nifty: Neural object interaction fields for guided human motion synthesis

N Kulkarni, D Rempe, K Genova… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of generating realistic 3D motions of humans interacting with
objects in a scene. Our key idea is to create a neural interaction field attached to a specific …

Guided motion diffusion for controllable human motion synthesis

K Karunratanakul, K Preechakul… - Proceedings of the …, 2023 - openaccess.thecvf.com
Denoising diffusion models have shown great promise in human motion synthesis
conditioned on natural language descriptions. However, integrating spatial constraints, such …

Humanise: Language-conditioned human motion generation in 3d scenes

Z Wang, Y Chen, T Liu, Y Zhu… - Advances in Neural …, 2022 - proceedings.neurips.cc
Learning to generate diverse scene-aware and goal-oriented human motions in 3D scenes
remains challenging due to the mediocre characters of the existing datasets on Human …

Controllable human-object interaction synthesis

J Li, A Clegg, R Mottaghi, J Wu, X Puig… - European Conference on …, 2024 - Springer
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …

Hierarchical generation of human-object interactions with diffusion probabilistic models

H Pi, S Peng, M Yang, X Zhou… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper presents a novel approach to generating the 3D motion of a human interacting
with a target object, with a focus on solving the challenge of synthesizing long-range and …

Stochastic scene-aware motion prediction

M Hassan, D Ceylan, R Villegas… - Proceedings of the …, 2021 - openaccess.thecvf.com
A long-standing goal in computer vision is to capture, model, and realistically synthesize
human behavior. Specifically, by learning from data, our goal is to enable virtual humans to …