Large motion model for unified multi-modal motion generation
Human motion generation, a cornerstone technique in animation and video production, has
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …
widespread applications in various tasks like text-to-motion and music-to-dance. Previous …
Emotional speech-driven 3d body animation via disentangled latent diffusion
Existing methods for synthesizing 3D human gestures from speech have shown promising
results but they do not explicitly model the impact of emotions on the generated gestures …
results but they do not explicitly model the impact of emotions on the generated gestures …
Chain of generation: Multi-modal gesture synthesis via cascaded conditional control
This study aims to improve the generation of 3D gestures by utilizing multimodal information
from human speech. Previous studies have focused on incorporating additional modalities …
from human speech. Previous studies have focused on incorporating additional modalities …
The diffusestylegesture+ entry to the genea challenge 2023
In this paper, we introduce the DiffuseStyleGesture+, our solution for the Generation and
Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which …
Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which …
Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis
In this work, we present Semantic Gesticulator, a novel framework designed to synthesize
realistic gestures accompanying speech with strong semantic correspondence. Semantically …
realistic gestures accompanying speech with strong semantic correspondence. Semantically …
BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics
The recently emerging text-to-motion advances have spired numerous attempts for
convenient and interactive human motion generation. Yet existing methods are largely …
convenient and interactive human motion generation. Yet existing methods are largely …
Mambatalk: Efficient holistic gesture synthesis with selective state space models
Gesture synthesis is a vital realm of human-computer interaction, with wide-ranging
applications across various fields like film, robotics, and virtual reality. Recent advancements …
applications across various fields like film, robotics, and virtual reality. Recent advancements …
Towards Variable and Coordinated Holistic Co-Speech Motion Generation
This paper addresses the problem of generating lifelike holistic co-speech motions for 3D
avatars focusing on two key aspects: variability and coordination. Variability allows the …
avatars focusing on two key aspects: variability and coordination. Variability allows the …
Diffugesture: Generating human gesture from two-person dialogue with diffusion models
W Zhao, L Hu, S Zhang - Companion Publication of the 25th International …, 2023 - dl.acm.org
This paper describes the DiffuGesture entry to the GENEA Challenge 2023. In this paper, we
utilize conditional diffusion models to formulate the gesture generation problem. The …
utilize conditional diffusion models to formulate the gesture generation problem. The …
Combo: Co-speech holistic 3D human motion generation and efficient customizable adaptation in harmony
In this paper, we propose a novel framework, Combo, for harmonious co-speech holistic 3D
human motion generation and efficient customizable adaption. In particular, we identify that …
human motion generation and efficient customizable adaption. In particular, we identify that …