Knowledge transfer in incremental learning for multilingual neural machine translation

K Huang, P Li, J Ma, T Yao, Y Liu - … of the 61st Annual Meeting of …, 2023 - aclanthology.org
In the real-world scenario, a longstanding goal of multilingual neural machine translation
(MNMT) is that a single model can incrementally adapt to new language pairs without …

Continual learning with semi-supervised contrastive distillation for incremental neural machine translation

Y Liang, F Meng, J Wang, J Xu, Y Chen… - Proceedings of the …, 2024 - aclanthology.org
Incrementally expanding the capability of an existing translation model to solve new domain
tasks over time is a fundamental and practical problem, which usually suffers from …

F-MALLOC: Feed-forward Memory Allocation for Continual Learning in Neural Machine Translation

J Wu, Y Liu, C Zong - arxiv preprint arxiv:2404.04846, 2024 - arxiv.org
In the evolving landscape of Neural Machine Translation (NMT), the pretrain-then-finetune
paradigm has yielded impressive results. However, the persistent challenge of Catastrophic …

Learn and Consolidate: Continual Adaptation for Zero-Shot and Multilingual Neural Machine Translation

K Huang, P Li, J Liu, M Sun, Y Liu - Proceedings of the 2023 …, 2023 - aclanthology.org
Although existing multilingual neural machine translation (MNMT) models have
demonstrated remarkable performance to handle multiple translation directions in a single …

Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model Division

J Liu, K Huang, H Yu, J Li, J Su… - Proceedings of the 2023 …, 2023 - aclanthology.org
A persistent goal of multilingual neural machine translation (MNMT) is to continually adapt
the model to support new language pairs or improve some current language pairs without …

TL-CL: Task And Language Incremental Continual Learning

S Satapara, PK Srijith - Proceedings of the 2024 Conference on …, 2024 - aclanthology.org
This paper introduces and investigates the problem of Task and Language Incremental
Continual Learning (TLCL), wherein a multilingual model is systematically updated to …

Towards Lifelong Learning of Large Language Models: A Survey

J Zheng, S Qiu, C Shi, Q Ma - arxiv preprint arxiv:2406.06391, 2024 - arxiv.org
As the applications of large language models (LLMs) expand across diverse fields, the
ability of these models to adapt to ongoing changes in data, tasks, and user preferences …

Optimizing Lifelong Fine-Tuning for Multiple Tasks via Dataless Distribution Replay

Z Wang - Proceedings of the 31st International Conference on …, 2025 - aclanthology.org
The recent emergence of various large language models, which can be fine-tuned with
minimal instruction data, has demonstrated impressive performance across various tasks …

Some Tradeoffs in Continual Learning for Parliamentary Neural Machine Translation Systems

R Knowles, S Larkin, M Simard… - Proceedings of the …, 2024 - aclanthology.org
In long-term translation projects, like Parliamentary text, there is a desire to build machine
translation systems that can adapt to changes over time. We implement and examine a …

Continual Learning with Confidence-based Multi-teacher Knowledge Distillation for Neural Machine Translation

J Guo, Y Liang, J Xu - 2024 6th International Conference on …, 2024 - ieeexplore.ieee.org
Continual learning is widely used in practical applications of neural machine translation,
which aims to not only achieve good performance on new domains but also preserve the …