Dubbing in practice: A large scale study of human localization with insights for automatic dubbing

W Brannon, Y Virkar, B Thompson - Transactions of the Association …, 2023 - direct.mit.edu
We investigate how humans perform the task of dubbing video content from one language
into another, leveraging a novel corpus of 319.57 hours of video from 54 professionally …

Videodubber: Machine translation with speech-aware length control for video dubbing

Y Wu, J Guo, X Tan, C Zhang, B Li, R Song… - Proceedings of the …, 2023 - ojs.aaai.org
Video dubbing aims to translate the original speech in a film or television program into the
speech in a target language, which can be achieved with a cascaded system consisting of …

Beyond the black mirror effect: the impact of machine translation in the audiovisual translation environment

J de los Reyes Lozano… - … , New Series–Themes in …, 2023 - lans.uantwerpen.be
In an increasingly globalized world, technological advancements and artificial intelligence
(AI) have catalysed the proliferation of audiovisual productions and their translation, leading …

Direct speech translation for automatic subtitling

S Papi, M Gaido, A Karakanta, M Cettolo… - Transactions of the …, 2023 - direct.mit.edu
Automatic subtitling is the task of automatically translating the speech of audiovisual content
into short pieces of timed text, ie, subtitles and their corresponding timestamps. The …

Jointly optimizing translations and speech timing to improve isochrony in automatic dubbing

A Chronopoulou, B Thompson, P Mathur… - arxiv preprint arxiv …, 2023 - arxiv.org
Automatic dubbing (AD) is the task of translating the original speech in a video into target
language speech. The new target language speech should satisfy isochrony; that is, the new …

Anim-400K: A Large-Scale Dataset for Automated End to End Dubbing of Video

K Cai, C Liu, DM Chan - ICASSP 2024-2024 IEEE International …, 2024 - ieeexplore.ieee.org
The Internet's wealth of content, with up to 60% published in English, starkly contrasts the
global population, where only 18.8% are English speakers, and just 5.1% consider it their …

[PDF][PDF] La traducción audiovisual a través de la traducción automática y la posedición

L Mejías-Climent… - Prácticas actuales y …, 2023 - ammonralibreria.com
La traducción audiovisual a través de la traducción automática y la posedición Page 1
Interlingua EDITORIAL COMARES La traducción audiovisual a través de la traducción …

Isochrony-Controlled Speech-to-Text Translation: A study on translating from Sino-Tibetan to Indo-European Languages

M Yousefi, Y Qian, J Chen, G Wang, Y Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
End-to-end speech translation (ST), which translates source language speech directly into
target language text, has garnered significant attention in recent years. Many ST …

Beyond words: leveraging language models for incremental and context-aware text-to-speech synthesis

B Stephenson - 2023 - theses.hal.science
Text-to-speech (TTS) technology has the potential to enable real-time communication for
applications such as automatic interpreters or assistive technologies for the speech …

Improving isochronous machine translation with target factors and auxiliary counters

P Pal, B Thompson, Y Virkar, P Mathur… - arxiv preprint arxiv …, 2023 - arxiv.org
To translate speech for automatic dubbing, machine translation needs to be isochronous, ie
translated speech needs to be aligned with the source in terms of speech durations. We …