Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

Large motion model for unified multi-modal motion generation

M Zhang, D **, C Gu, F Hong, Z Cai, J Huang… - … on Computer Vision, 2024 - Springer
Human motion generation, a cornerstone technique in animation and video production, has
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …

Lodge: A coarse to fine diffusion network for long dance generation guided by the characteristic dance primitives

R Li, YX Zhang, Y Zhang, H Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
We propose Lodge a network capable of generating extremely long dance sequences
conditioned on given music. We design Lodge as a two-stage coarse to fine diffusion …

CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation

X Liu, Y Guo, C Zhen, T Li, Y Ao… - Proceedings of the …, 2024 - openaccess.thecvf.com
Listening head generation aims to synthesize a non-verbal responsive listener head by
modeling the correlation between the speaker and the listener in dynamic conversion. The …

Music-driven synchronous dance generation considering K-pop musical and choreographical characteristics

S Kim, K Lee - IEEE Access, 2024 - ieeexplore.ieee.org
Generating dance movements from music has been considered a highly challenging task,
as it requires the model to comprehend concepts from two different modalities: audio and …

Rethinking Sampling for Music-Driven Long-Term Dance Generation

TV Truong-Thuy, GC Bui-Le… - Proceedings of the …, 2024 - openaccess.thecvf.com
Generating dance sequences that synchronize with music while maintaining naturalness
and realism is a challenging task. Existing methods often suffer from freezing phenomena or …

Harmonious Group Choreography with Trajectory-Controllable Diffusion

Y Dai, W Zhu, R Li, Z Ren, X Zhou, X Li, J Li… - arxiv preprint arxiv …, 2024 - arxiv.org
Creating group choreography from music has gained attention in cultural entertainment and
virtual reality, aiming to coordinate visually cohesive and diverse group movements. Despite …

Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns

R Li, H Zhang, Y Zhang, Y Zhang, Y Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
We propose Lodge++, a choreography framework to generate high-quality, ultra-long, and
vivid dances given the music and desired genre. To handle the challenges in computational …

Lagrangian Motion Fields for Long-term Motion Generation

Y Yang, Z Huang, C Xu, S He - arxiv preprint arxiv:2409.01522, 2024 - arxiv.org
Long-term motion generation is a challenging task that requires producing coherent and
realistic sequences over extended durations. Current methods primarily rely on framewise …

DGFM: Full Body Dance Generation Driven by Music Foundation Models

X Liu, Z Feng, D Kanojia, W Wang - … AI-Driven Speech, Music, and Sound … - openreview.net
In music-driven dance motion generation, most existing methods use hand-crafted features
and neglect that music foundation models have profoundly impacted cross-modal content …