Can One Model Fit All? An Exploration of Wav2Lip's Lip-Syncing Generalizability Across Culturally Distinct Languages

A Rafiei Oskooei, E Yahsi, M Sungur… - … on Computational Science …, 2024 - Springer
This study explores the potential of Wav2Lip, a state-of-the-art lip-sync model, in multilingual
environments. We assess its performance in generating lip-synchronized videos for Turkish …

[HTML][HTML] Seeing the Sound: Multilingual Lip Sync for Real-Time Face-to-Face Translation

A Rafiei Oskooei, MS Aktaş, M Keleş - Computers, 2024 - mdpi.com
Imagine a future where language is no longer a barrier to real-time conversations, enabling
instant and lifelike communication across the globe. As cultural boundaries blur, the demand …

An Embodied Conversational Agent to Support Wellbeing After Injury: Insights from a Stakeholder Inclusive Design Approach

K Hopman, D Richards, MN Norberg - International Conference on …, 2024 - Springer
Embodied conversational agents (ECAs) are increasingly being included in digital health
and wellbeing programs. Whilst initial evaluations of ECAs in this field have been promising …

[PDF][PDF] Foreign language visemes for use in lip-synching with computer-generated audio

J Whipple, R Agada, J Yan - J. Comput. Sci. Inf. Technol, 2017 - scholar.archive.org
There are several state-of-art for animating human motion, most of which involves the use of
markers on the human and a tracker that estimates movement based on the position and …

Automated lip-sync framework for video game

HAM Adanan, I Mashud… - AIP Conference …, 2023 - pubs.aip.org
An automated lip-sync framework using the Unreal Engine 4 (UE4) game engine is
presented. The main objective is to create a modular and lightweight lip-sync framework that …

Synchronization of Speech for Synthetic Avatars in Virtual Reality

L Boráros, J Lacko - Information Technology Applications, 2024 - itajournal.com
The goal of this research paper is to review existing methods of voice synchronization for
avatars in virtual reality environment and to implement one of the existing methods or to …

[PDF][PDF] Accuracy performance and potentiality of real-time avatar lip sync animation in different languages

NH Loh, SS Shaharuddin - International Journal of Recent …, 2019 - researchgate.net
With the fast growth in computing power nowadays, the qualities of animation enable an
extra layer of visually convincing realism. In lip sync animation, creation of realistic lip …

A review on data-driven learning of a talking head model

KK Htike - … Journal of Intelligent Systems Technologies and …, 2017 - inderscienceonline.com
Constructing a talking head model of a person allows generation of a novel talking face
animation from an unseen audio sequence of the person. This has important applications …

The Use of 3D Viseme Transition Units for Improved Speech Animation

MV Leflar - 2016 - repository.library.carleton.ca
A realistic speech synthesis tool could be used in dynamic therapeutic applications as well
as revolutionize the animation pipeline in the entertainment industry. In this thesis, we …

Development of a humanoid robot mouth with text-to-speech ability

L Harshani, W Weerasooriya, H Herath… - 2021 - ir.lib.seu.ac.lk
This is a study of lip movements when speaking the English language, developed humanoid
robot face with moving lips and text-to-speech ability. A humanoid robot face is a robotic face …