Generative audio models typically focus their applications in music and speech generation,
with recent models having human-like quality in their audio output. This paper conducts a …

Virtual human is widely employed in various industries, including personal assistance,
intelligent customer service, and online education, thanks to the rapid development of …

Multi-media communications facilitate global interaction among people. However, despite
researchers exploring cross-lingual translation techniques such as machine translation and …

In the task of talking face generation the objective is to generate a face video with lips
synchronized to the corresponding audio while preserving visual details and identity …

Expressive speech-to-speech translation (S2ST) aims to transfer prosodic attributes of
source speech to target speech while maintaining translation accuracy. Existing research in …

Direct speech-to-speech translation achieves high-quality results through the introduction of
discrete units obtained from self-supervised learning. This approach circumvents delays and …

This systematic literature review (SLR) explores the topic of Facial Expression and Lip
Movement Synchronization of an Audio Track in the context of Automatic Dubbing. This SLR …

The goal of talking face generation is to synthesize a sequence of face images of the
specified identity, ensuring the mouth movements are synchronized with the given audio …

This paper proposes a novel direct Audio-Visual Speech to Audio-Visual Speech
Translation (AV2AV) framework where the input and output of the system are multimodal (ie …

Current research in speech-to-speech translation (S2ST) primarily concentrates on
translation accuracy and speech naturalness, often overlooking key elements like …