A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

Gesturediffuclip: Gesture diffusion model with clip latents

T Ao, Z Zhang, L Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
The automatic generation of stylized co-speech gestures has recently received increasing
attention. Previous systems typically allow style control via predefined text labels or example …

Emotional speech-driven 3d body animation via disentangled latent diffusion

K Chhatre, N Athanasiou, G Becherini… - Proceedings of the …, 2024 - openaccess.thecvf.com
Existing methods for synthesizing 3D human gestures from speech have shown promising
results but they do not explicitly model the impact of emotions on the generated gestures …

On the domain adaptation and generalization of pretrained language models: A survey

X Guo, H Yu - arxiv preprint arxiv:2211.03154, 2022 - arxiv.org
Recent advances in NLP are brought by a range of large-scale pretrained language models
(PLMs). These PLMs have brought significant performance gains for a range of NLP tasks …

The diffusestylegesture+ entry to the genea challenge 2023

S Yang, H Xue, Z Zhang, M Li, Z Wu, X Wu… - Proceedings of the 25th …, 2023 - dl.acm.org
In this paper, we introduce the DiffuseStyleGesture+, our solution for the Generation and
Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which …

Continual learning for personalized co-speech gesture generation

C Ahuja, P Joshi, R Ishii… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Co-speech gestures are a key channel of human communication, making them important for
personalized chat agents to generate. In the past, gesture generation models assumed that …

A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation

L Liu, L Gao, W Lei, F Ma, X Lin, J Wang - arxiv preprint arxiv:2308.08849, 2023 - arxiv.org
Body language (BL) refers to the non-verbal communication expressed through physical
movements, gestures, facial expressions, and postures. It is a form of communication that …

Zero-shot style transfer for gesture animation driven by text and speech using adversarial disentanglement of multimodal style encoding

M Fares, C Pelachaud, N Obin - Frontiers in Artificial Intelligence, 2023 - frontiersin.org
Modeling virtual agents with behavior style is one factor for personalizing human-agent
interaction. We propose an efficient yet effective machine learning approach to synthesize …

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

T Kucherenko*, P Wolfert*, Y Yoon*, C Viegas… - ACM Transactions on …, 2024 - dl.acm.org
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

A Generative Model to Embed Human Expressivity into Robot Motions

P Osorio, R Sagawa, N Abe, G Venture - Sensors, 2024 - mdpi.com
This paper presents a model for generating expressive robot motions based on human
expressive movements. The proposed data-driven approach combines variational …