A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

Listen, denoise, action! audio-driven motion synthesis with diffusion models

S Alexanderson, R Nagy, J Beskow… - ACM Transactions on …, 2023 - dl.acm.org
Diffusion models have experienced a surge of interest as highly expressive yet efficiently
trainable probabilistic models. We show that these models are an excellent fit for …

Psychological impact and influence of animation on viewer's visual attention and cognition: A systematic literature review, open challenges, and future research …

CK Praveen, K Srinivasan - Computational and Mathematical …, 2022 - Wiley Online Library
Animation is an excellent method to associate with the audience in a fun and innovative
manner. In recent span, animation has been employed in various fields to enhance …

Style‐controllable speech‐driven gesture synthesis using normalising flows

S Alexanderson, GE Henter… - Computer Graphics …, 2020 - Wiley Online Library
Automatic synthesis of realistic gestures promises to transform the fields of animation,
avatars and communicative agents. In off‐line applications, novel tools can alter the role of …

A motion matching-based framework for controllable gesture synthesis from speech

I Habibie, M Elgharib, K Sarkar, A Abdullah… - ACM SIGGRAPH 2022 …, 2022 - dl.acm.org
Recent deep learning-based approaches have shown promising results for synthesizing
plausible 3D human gestures from speech input. However, these approaches typically offer …

A conversational agent framework with multi-modal personality expression

S Sonlu, U Güdükbay, F Durupinar - ACM Transactions on Graphics …, 2021 - dl.acm.org
Consistently exhibited personalities are crucial elements of realistic, engaging, and behavior-
rich conversational virtual agents. Both nonverbal and verbal cues help convey these …

Efficient neural networks for real-time motion style transfer

HJ Smith, C Cao, M Neff, Y Wang - … of the ACM on Computer Graphics …, 2019 - dl.acm.org
Style is an intrinsic, inescapable part of human motion. It complements the content of motion
to convey meaning, mood, and personality. Existing state-of-the-art motion style methods …

Investigating how speech and animation realism influence the perceived personality of virtual characters and agents

S Thomas, Y Ferstl, R McDonnell… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
The portrayed personality of virtual characters and agents is understood to influence how we
perceive and engage with digital applications. Understanding how the features of speech …

Human or Robot? Investigating voice, appearance and gesture motion realism of conversational social agents

Y Ferstl, S Thomas, C Guiard, C Ennis… - Proceedings of the 21st …, 2021 - dl.acm.org
Research on creation of virtual humans enables increasing automatization of their behavior,
including synthesis of verbal and nonverbal behavior. As the achievable realism of different …

A framework of personality cues for conversational agents

R Ahmad, D Siemon, U Gnewuch… - 2022 - scholarspace.manoa.hawaii.edu
Conversational agents (CAs)—software systems emulating conversations with humans
through natural language—reshape our communication environment. As CAs have been …