Facediffuser: Speech-driven 3d facial animation synthesis using diffusion

S Stan, KI Haque, Z Yumak - Proceedings of the 16th ACM SIGGRAPH …, 2023 - dl.acm.org
Speech-driven 3D facial animation synthesis has been a challenging task both in industry
and research. Recent methods mostly focus on deterministic deep learning methods …

A conversational agent framework with multi-modal personality expression

S Sonlu, U Güdükbay, F Durupinar - ACM Transactions on Graphics …, 2021 - dl.acm.org
Consistently exhibited personalities are crucial elements of realistic, engaging, and behavior-
rich conversational virtual agents. Both nonverbal and verbal cues help convey these …

Facexhubert: Text-less speech-driven e (x) pressive 3d facial animation synthesis using self-supervised speech representation learning

KI Haque, Z Yumak - Proceedings of the 25th International Conference …, 2023 - dl.acm.org
This paper presents FaceXHuBERT, a text-less speech-driven 3D facial animation
generation method that generates facial cues driven by an emotional expressiveness …

[HTML][HTML] Audio-Driven Facial Animation with Deep Learning: A Survey

D Jiang, J Chang, L You, S Bian, R Kosk, G Maguire - Information, 2024 - mdpi.com
Audio-driven facial animation is a rapidly evolving field that aims to generate realistic facial
expressions and lip movements synchronized with a given audio input. This survey provides …

Effects on co-presence of a virtual human: A comparison of display and interaction types

D Kim, D Jo - Electronics, 2022 - mdpi.com
Recently, artificial intelligence (AI)-enabled virtual humans have been widely used in
various fields in our everyday lives, such as for museum exhibitions and as information …

Transformer-s2a: Robust and efficient speech-to-animation

L Chen, Z Wu, J Ling, R Li, X Tan… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
We propose a novel robust and efficient Speech-to-Animation (S2A) approach for
synchronized facial animation generation in human-computer interaction. Compared with …

3D facial modeling, animation, and rendering for digital humans: A survey

Y Zhang, R Su, J Yu, R Li - Neurocomputing, 2024 - Elsevier
With the continuous advancement of 3D and human–computer interaction technologies,
digital human systems have been widely implemented in our daily lives, such as 3D games …

Animation design using virtual reality modeling and fractal morphing technology

Y Wang, N Zhang, D Chen, J Vongphantuset - Fractals, 2022 - World Scientific
The fractal Iterated Function System (IFS) algorithm is studied to simulate swinging plants'
animation effect under natural conditions. First, the collage method and the IFS attractor …

ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE

S Wu, KI Haque, Z Yumak - Proceedings of the 17th ACM SIGGRAPH …, 2024 - dl.acm.org
Audio-driven 3D facial animation synthesis has been an active field of research with
attention from both academia and industry. While there are promising results in this area …