No language left behind: Scaling human-centered machine translation

MR Costa-Jussà, J Cross, O Çelebi, M Elbayad… - arxiv preprint arxiv …, 2022 - arxiv.org
Driven by the goal of eradicating language barriers on a global scale, machine translation
has solidified itself as a key focus of artificial intelligence research today. However, such …

A survey on non-autoregressive generation for neural machine translation and beyond

Y **ao, L Wu, J Guo, J Li, M Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Non-autoregressive (NAR) generation, which is first proposed in neural machine translation
(NMT) to speed up inference, has attracted much attention in both machine learning and …

[PDF][PDF] No language left behind: Scaling human-centered machine translation

N Team, MR Costa-Jussà, J Cross, O Çelebi… - arxiv preprint arxiv …, 2022 - academia.edu
Driven by the goal of eradicating language barriers on a global scale, machine translation
has solidified itself as a key focus of artificial intelligence research today. However, such …

A survey of non-autoregressive neural machine translation

F Li, J Chen, X Zhang - Electronics, 2023 - mdpi.com
Non-autoregressive neural machine translation (NAMT) has received increasing attention
recently in virtue of its promising acceleration paradigm for fast decoding. However, these …

A baseline revisited: Pushing the limits of multi-segment models for context-aware translation

S Majumder, S Lauly, M Nadejde, M Federico… - arxiv preprint arxiv …, 2022 - arxiv.org
This paper addresses the task of contextual translation using multi-segment models.
Specifically we show that increasing model capacity further pushes the limits of this …

Contrastive conditioning for assessing disambiguation in MT: A case study of distilled bias

J Vamvas, R Sennrich - 2021 Conference on Empirical Methods …, 2021 - research.ed.ac.uk
Lexical disambiguation is a major challenge for machine translation systems, especially if
some senses of a word are trained less often than others. Identifying patterns of …

Non-autoregressive sequence generation

J Gu, X Tan - Proceedings of the 60th Annual Meeting of the …, 2022 - aclanthology.org
Non-autoregressive sequence generation (NAR) attempts to generate the entire or partial
output sequences in parallel to speed up the generation process and avoid potential issues …

Non-autoregressive neural machine translation: A call for clarity

RM Schmidt, T Pires, S Peitz, J Lööf - arxiv preprint arxiv:2205.10577, 2022 - arxiv.org
Non-autoregressive approaches aim to improve the inference speed of translation models
by only requiring a single forward pass to generate the output sequence instead of iteratively …

Falcon: Faster and Parallel Inference of Large Language Models through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree

X Gao, W **e, Y **ang, F Ji - arxiv preprint arxiv:2412.12639, 2024 - arxiv.org
Striking an optimal balance between minimal drafting latency and high speculation accuracy
to enhance the inference speed of Large Language Models remains a significant challenge …

Integrating translation memories into non-autoregressive machine translation

J Xu, J Crego, F Yvon - arxiv preprint arxiv:2210.06020, 2022 - arxiv.org
Non-autoregressive machine translation (NAT) has recently made great progress. However,
most works to date have focused on standard translation tasks, even though some edit …