Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023‏ - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

ARCTIC: A dataset for dexterous bimanual hand-object manipulation

Z Fan, O Taheri, D Tzionas… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
Humans intuitively understand that inanimate objects do not move by themselves, but that
state changes are typically caused by human manipulation (eg, the opening of a book). This …

Interdreamer: Zero-shot text to 3d dynamic human-object interaction

S Xu, YX Wang, L Gui - Advances in Neural Information …, 2025‏ - proceedings.neurips.cc
Text-conditioned human motion generation has experienced significant advancements with
diffusion models trained on extensive motion capture data and corresponding textual …

Handiffuser: Text-to-image generation with realistic hand appearances

S Narasimhaswamy, U Bhattacharya… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
Text-to-image generative models can generate high-quality humans but realism is lost when
generating hands. Common artifacts include irregular hand poses shapes incorrect numbers …

Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024‏ - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

Text2hoi: Text-guided 3d motion generation for hand-object interaction

J Cha, J Kim, JS Yoon, S Baek - Proceedings of the IEEE …, 2024‏ - openaccess.thecvf.com
This paper introduces the first text-guided work for generating the sequence of hand-object
interaction in 3D. The main challenge arises from the lack of labeled data where existing …

Contactgen: Generative contact modeling for grasp generation

S Liu, Y Zhou, J Yang, S Gupta… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
This paper presents a novel object-centric contact representation ContactGen for hand-
object interaction. The ContactGen comprises 3 components: a contact map indicates the …

Taco: Benchmarking generalizable bimanual tool-action-object understanding

Y Liu, H Yang, X Si, L Liu, Z Li… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
Humans commonly work with multiple objects in daily life and can intuitively transfer
manipulation skills to novel objects by understanding object functional regularities. However …

Gears: Local geometry-aware hand-object interaction synthesis

K Zhou, BL Bhatnagar, JE Lenssen… - Proceedings of the …, 2024‏ - openaccess.thecvf.com
Generating realistic hand motion sequences in interaction with objects has gained
increasing attention with the growing interest in digital humans. Prior work has illustrated the …

Object pop-up: Can we infer 3d objects and their poses from human interactions alone?

IA Petrov, R Marin, J Chibane… - Proceedings of the …, 2023‏ - openaccess.thecvf.com
The intimate entanglement between objects affordances and human poses is of large
interest, among others, for behavioural sciences, cognitive psychology, and Computer …