Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Edge: Editable dance generation from music

J Tseng, R Castellon, K Liu - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Dance is an important human art form, but creating new dances can be difficult and time-
consuming. In this work, we introduce Editable Dance GEneration (EDGE), a state-of-the-art …

Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Nifty: Neural object interaction fields for guided human motion synthesis

N Kulkarni, D Rempe, K Genova… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of generating realistic 3D motions of humans interacting with
objects in a scene. Our key idea is to create a neural interaction field attached to a specific …

ARCTIC: A dataset for dexterous bimanual hand-object manipulation

Z Fan, O Taheri, D Tzionas… - Proceedings of the …, 2023 - openaccess.thecvf.com
Humans intuitively understand that inanimate objects do not move by themselves, but that
state changes are typically caused by human manipulation (eg, the opening of a book). This …

Epic-kitchens visor benchmark: Video segmentations and object relations

A Darkhalil, D Shan, B Zhu, J Ma… - Advances in …, 2022 - proceedings.neurips.cc
We introduce VISOR, a new dataset of pixel annotations and a benchmark suite for
segmenting hands and active objects in egocentric video. VISOR annotates videos from …

Controllable human-object interaction synthesis

J Li, A Clegg, R Mottaghi, J Wu, X Puig… - European Conference on …, 2024 - Springer
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …

Hierarchical generation of human-object interactions with diffusion probabilistic models

H Pi, S Peng, M Yang, X Zhou… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper presents a novel approach to generating the 3D motion of a human interacting
with a target object, with a focus on solving the challenge of synthesizing long-range and …

Object motion guided human motion synthesis

J Li, J Wu, CK Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
Modeling human behaviors in contextual environments has a wide range of applications in
character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans …

Diffusion-guided reconstruction of everyday hand-object interaction clips

Y Ye, P Hebbar, A Gupta… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We tackle the task of reconstructing hand-object interactions from short video clips. Given an
input video, our approach casts 3D inference as a per-video optimization and recovers a …