A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …
human communication. The automatic generation of such co‐speech gestures is a long …
A review of evaluation practices of gesture generation in embodied conversational agents
Embodied conversational agents (ECAs) are often designed to produce nonverbal behavior
to complement or enhance their verbal communication. One such form of the nonverbal …
to complement or enhance their verbal communication. One such form of the nonverbal …
Gesturediffuclip: Gesture diffusion model with clip latents
T Ao, Z Zhang, L Liu - ACM Transactions on Graphics (TOG), 2023 - dl.acm.org
The automatic generation of stylized co-speech gestures has recently received increasing
attention. Previous systems typically allow style control via predefined text labels or example …
attention. Previous systems typically allow style control via predefined text labels or example …
Rhythmic gesticulator: Rhythm-aware co-speech gesture synthesis with hierarchical neural embeddings
Automatic synthesis of realistic co-speech gestures is an increasingly important yet
challenging task in artificial embodied agent creation. Previous systems mainly focus on …
challenging task in artificial embodied agent creation. Previous systems mainly focus on …
Speech gesture generation from the trimodal context of text, audio, and speaker identity
For human-like agents, including virtual avatars and social robots, making proper gestures
while speaking is crucial in human-agent interaction. Co-speech gestures enhance …
while speaking is crucial in human-agent interaction. Co-speech gestures enhance …
Learning individual styles of conversational gesture
Human speech is often accompanied by hand and arm gestures. We present a method for
cross-modal translation from" in-the-wild" monologue speech of a single speaker to their …
cross-modal translation from" in-the-wild" monologue speech of a single speaker to their …
ZeroEGGS: Zero‐shot Example‐based Gesture Generation from Speech
We present ZeroEGGS, a neural network framework for speech‐driven gesture generation
with zero‐shot style control by example. This means style can be controlled via only a short …
with zero‐shot style control by example. This means style can be controlled via only a short …
Gesture and speech in interaction: An overview
Gestures and speech interact. They are linked in language production and perception, with
their interaction contributing to felicitous communication. The multifaceted nature of these …
their interaction contributing to felicitous communication. The multifaceted nature of these …
Style transfer for co-speech gesture animation: A multi-speaker conditional-mixture approach
How can we teach robots or virtual assistants to gesture naturally? Can we go further and
adapt the gesturing style to follow a specific speaker? Gestures that are naturally timed with …
adapt the gesturing style to follow a specific speaker? Gestures that are naturally timed with …
Learning speech-driven 3d conversational gestures from video
We propose the first approach to synthesize the synchronous 3D conversational body and
hand gestures, as well as 3D face and head animations, of a virtual character from speech …
hand gestures, as well as 3D face and head animations, of a virtual character from speech …