Large motion model for unified multi-modal motion generation
Human motion generation, a cornerstone technique in animation and video production, has
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …
DanceGen: Supporting Choreography Ideation and Prototy** with Generative AI
Choreography creation requires high proficiency in artistic and technical skills.
Choreographers typically go through four stages to create a dance piece: preparation …
Choreographers typically go through four stages to create a dance piece: preparation …
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer
Speech-driven 3D facial animation is important for many multimedia applications. Recent
work has shown promise in using either Diffusion models or Transformer architectures for …
work has shown promise in using either Diffusion models or Transformer architectures for …
Scalable Group Choreography via Variational Phase Manifold Learning
Generating group dance motion from the music is a challenging task with several industrial
applications. Although several methods have been proposed to tackle this problem, most of …
applications. Although several methods have been proposed to tackle this problem, most of …
Beat-It: Beat-Synchronized Multi-Condition 3D Dance Generation
Dance, as an art form, fundamentally hinges on the precise synchronization with musical
beats. However, achieving aesthetically pleasing dance sequences from music is …
beats. However, achieving aesthetically pleasing dance sequences from music is …
Music-driven synchronous dance generation considering K-pop musical and choreographical characteristics
S Kim, K Lee - IEEE Access, 2024 - ieeexplore.ieee.org
Generating dance movements from music has been considered a highly challenging task,
as it requires the model to comprehend concepts from two different modalities: audio and …
as it requires the model to comprehend concepts from two different modalities: audio and …
InterDance: Reactive 3D Dance Generation with Realistic Duet Interactions
R Li, Y Zhang, Y Zhang, Y Zhang, M Su, J Guo… - arxiv preprint arxiv …, 2024 - arxiv.org
Humans perform a variety of interactive motions, among which duet dance is one of the most
challenging interactions. However, in terms of human motion generative models, existing …
challenging interactions. However, in terms of human motion generative models, existing …
Dance Any Beat: Blending Beats with Visuals in Dance Video Generation
The task of generating dance from music is crucial, yet current methods, which mainly
produce joint sequences, lead to outputs that lack intuitiveness and complicate data …
produce joint sequences, lead to outputs that lack intuitiveness and complicate data …
CoDancers: Music-Driven Coherent Group Dance Generation with Choreographic Unit
Dance and music are intimately interconnected, with group dance being a crucial part of
dance artistry. Consequently, Music-Driven Group Dance Generation has been a …
dance artistry. Consequently, Music-Driven Group Dance Generation has been a …
SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimization
Text-to-motion generation is essential for advancing the creative industry but often presents
challenges in producing consistent, realistic motions. To address this, we focus on fine …
challenges in producing consistent, realistic motions. To address this, we focus on fine …