State of the art on diffusion models for visual computing

R Po, W Yifan, V Golyanik, K Aberman… - Computer Graphics …, 2024 - Wiley Online Library
The field of visual computing is rapidly advancing due to the emergence of generative
artificial intelligence (AI), which unlocks unprecedented capabilities for the generation …

Interdiff: Generating 3d human-object interactions with physics-informed diffusion

S Xu, Z Li, YX Wang, LY Gui - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
This paper addresses a novel task of anticipating 3D human-object interactions (HOIs). Most
existing research on HOI synthesis lacks comprehensive whole-body interactions with …

Controllable human-object interaction synthesis

J Li, A Clegg, R Mottaghi, J Wu, X Puig… - European Conference on …, 2024 - Springer
Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate
realistic human behaviors. In this work, we address the challenging problem of generating …

Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

Large motion model for unified multi-modal motion generation

M Zhang, D **, C Gu, F Hong, Z Cai, J Huang… - … on Computer Vision, 2024 - Springer
Human motion generation, a cornerstone technique in animation and video production, has
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …

Omnicontrol: Control any joint at any time for human motion generation

Y **e, V Jampani, L Zhong, D Sun, H Jiang - arxiv preprint arxiv …, 2023 - arxiv.org
We present a novel approach named OmniControl for incorporating flexible spatial control
signals into a text-conditioned human motion generation model based on the diffusion …

Remos: 3d motion-conditioned reaction synthesis for two-person interactions

A Ghosh, R Dabral, V Golyanik, C Theobalt… - … on Computer Vision, 2024 - Springer
Current approaches for 3D human motion synthesis generate high-quality animations of
digital humans performing a wide variety of actions and gestures. However, a notable …

Hoi-diff: Text-driven synthesis of 3d human-object interactions using diffusion models

X Peng, Y **e, Z Wu, V Jampani, D Sun… - arxiv preprint arxiv …, 2023 - arxiv.org
We address the problem of generating realistic 3D human-object interactions (HOIs) driven
by textual prompts. Instead of a single model, our key insight is to take a modular design and …

Multi-track timeline control for text-driven 3d human motion generation

M Petrovich, O Litany, U Iqbal… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recent advances in generative modeling have led to promising progress on synthesizing
3D human motion from text with methods that can generate character animations from short …

Smoodi: Stylized motion diffusion model

L Zhong, Y **e, V Jampani, D Sun, H Jiang - European Conference on …, 2024 - Springer
We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized
motion driven by content texts and style motion sequences. Unlike existing methods that …