Transformers have made significant strides across various artificial intelligence domains,
including natural language processing, computer vision, and audio processing. This …

This paper proposes a novel direct Audio-Visual Speech to Audio-Visual Speech
Translation (AV2AV) framework where the input and output of the system are multimodal (ie …

This paper explores sentence-level multilingual Visual Speech Recognition (VSR) that can
recognize different languages with a single trained model. As the massive multilingual …

This paper explores sentence-level Multilingual Visual Speech Recognition with a single
model for the first time. As the massive multilingual modeling of visual data requires huge …

The capability to jointly process multi-modal information is becoming an essential task.
However, the limited number of paired multi-modal data and the large computational …

Self-supervised learning (SSL) models have shown exceptional capabilities across various
speech-processing tasks. Continuous SSL representations are effective but suffer from high …

Generating novel voices in speech synthesis is a challenging task with potential for creating
versatile voices that are needed in entertainment and research. One of the primary obstacles …

摘要語音自監督學習模型在各種語音處理任務中展示了卓越的能力. 使用語音自監督模型連續
特徵訓練模型雖然性能強大, 但卻受限於其高計算和存儲成本. 另一方面, 雖然使用語音自監督 …