A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …
human communication. The automatic generation of such co‐speech gestures is a long …
Gesturediffuclip: Gesture diffusion model with clip latents
T Ao, Z Zhang, L Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
The automatic generation of stylized co-speech gestures has recently received increasing
attention. Previous systems typically allow style control via predefined text labels or example …
attention. Previous systems typically allow style control via predefined text labels or example …
Emotional speech-driven 3d body animation via disentangled latent diffusion
Existing methods for synthesizing 3D human gestures from speech have shown promising
results but they do not explicitly model the impact of emotions on the generated gestures …
results but they do not explicitly model the impact of emotions on the generated gestures …
On the domain adaptation and generalization of pretrained language models: A survey
Recent advances in NLP are brought by a range of large-scale pretrained language models
(PLMs). These PLMs have brought significant performance gains for a range of NLP tasks …
(PLMs). These PLMs have brought significant performance gains for a range of NLP tasks …
The diffusestylegesture+ entry to the genea challenge 2023
In this paper, we introduce the DiffuseStyleGesture+, our solution for the Generation and
Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which …
Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which …
Continual learning for personalized co-speech gesture generation
Co-speech gestures are a key channel of human communication, making them important for
personalized chat agents to generate. In the past, gesture generation models assumed that …
personalized chat agents to generate. In the past, gesture generation models assumed that …
A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation
Body language (BL) refers to the non-verbal communication expressed through physical
movements, gestures, facial expressions, and postures. It is a form of communication that …
movements, gestures, facial expressions, and postures. It is a form of communication that …
Zero-shot style transfer for gesture animation driven by text and speech using adversarial disentanglement of multimodal style encoding
Modeling virtual agents with behavior style is one factor for personalizing human-agent
interaction. We propose an efficient yet effective machine learning approach to synthesize …
interaction. We propose an efficient yet effective machine learning approach to synthesize …
Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …
speech gesture generation. Participating teams used the same speech and motion dataset …
A Generative Model to Embed Human Expressivity into Robot Motions
This paper presents a model for generating expressive robot motions based on human
expressive movements. The proposed data-driven approach combines variational …
expressive movements. The proposed data-driven approach combines variational …