Modular deep learning

J Pfeiffer, S Ruder, I Vulić, EM Ponti - arxiv preprint arxiv:2302.11529, 2023 - arxiv.org
Transfer learning has recently become the dominant paradigm of machine learning. Pre-
trained models fine-tuned for downstream tasks achieve better performance with fewer …

Simple, scalable adaptation for neural machine translation

A Bapna, N Arivazhagan, O Firat - arxiv preprint arxiv:1909.08478, 2019 - arxiv.org
Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach
for adapting to new languages and domains. However, fine-tuning requires adapting and …

A survey of domain adaptation for machine translation

C Chu, R Wang - Journal of information processing, 2020 - jstage.jst.go.jp
Neural machine translation (NMT) is a deep learning based approach for machine
translation, which outperforms traditional statistical machine translation (SMT) and yields the …

Tagged back-translation

I Caswell, C Chelba, D Grangier - arxiv preprint arxiv:1906.06442, 2019 - arxiv.org
Recent work in Neural Machine Translation (NMT) has shown significant quality gains from
noised-beam decoding during back-translation, a method to generate synthetic parallel …

Domain adaptation and multi-domain adaptation for neural machine translation: A survey

D Saunders - Journal of Artificial Intelligence Research, 2022 - jair.org
The development of deep learning techniques has allowed Neural Machine Translation
(NMT) models to become extremely powerful, given sufficient training data and training time …

Overcoming catastrophic forgetting during domain adaptation of neural machine translation

B Thompson, J Gwinnup, H Khayrallah… - … Conference of the …, 2019 - research.ed.ac.uk
Continued training is an effective method for domain adaptation in neural machine
translation. However, in-domain gains from adaptation come at the expense of general …

Uncertainty-aware curriculum learning for neural machine translation

Y Zhou, B Yang, DF Wong, Y Wan… - Proceedings of the 58th …, 2020 - aclanthology.org
Neural machine translation (NMT) has proven to be facilitated by curriculum learning which
presents examples in an easy-to-hard order at different training stages. The keys lie in the …

The SIGMORPHON 2019 shared task: Morphological analysis in context and cross-lingual transfer for inflection

AD McCarthy, E Vylomova, S Wu, C Malaviya… - arxiv preprint arxiv …, 2019 - arxiv.org
The SIGMORPHON 2019 shared task on cross-lingual transfer and contextual analysis in
morphology examined transfer learning of inflection between 100 language pairs, as well as …

Seqtrans: automatic vulnerability fix via sequence to sequence learning

J Chi, Y Qu, T Liu, Q Zheng… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Software vulnerabilities are now reported unprecedentedly due to the recent development of
automated vulnerability hunting tools. However, fixing vulnerabilities still mainly depends on …

LLMs-based machine translation for E-commerce

D Gao, K Chen, B Chen, H Dai, L **, W Jiang… - Expert Systems with …, 2024 - Elsevier
Large language models (LLMs) have shown promising performance for various downstream
tasks, especially machine translation. However, LLMs and Specialized Translation Models …