[PDF][PDF] Neural transfer learning for natural language processing

S Ruder - 2019 - raw.githubusercontent.com
Language is often regarded as the hallmark of human intelligence. Develo** systems that
can understand human language is thus one of the main obstacles on the quest towards …

A survey of domain adaptation for machine translation

C Chu, R Wang - Journal of information processing, 2020 - jstage.jst.go.jp
Neural machine translation (NMT) is a deep learning based approach for machine
translation, which outperforms traditional statistical machine translation (SMT) and yields the …

How transferable are neural networks in NLP applications?

L Mou, Z Meng, R Yan, G Li, Y Xu, L Zhang… - arxiv preprint arxiv …, 2016 - arxiv.org
Transfer learning is aimed to make use of valuable knowledge in a source domain to help
model performance in a target domain. It is particularly important to neural networks, which …

Domain adaptation and multi-domain adaptation for neural machine translation: A survey

D Saunders - Journal of Artificial Intelligence Research, 2022 - jair.org
The development of deep learning techniques has allowed Neural Machine Translation
(NMT) models to become extremely powerful, given sufficient training data and training time …

[PDF][PDF] Domain adaptation via pseudo in-domain data selection

A Axelrod, X He, J Gao - Proceedings of the 2011 conference on …, 2011 - aclanthology.org
We explore efficient domain adaptation for the task of statistical machine translation based
on extracting sentences from a large generaldomain parallel corpus that are most relevant to …

AdaptSum: Towards low-resource domain adaptation for abstractive summarization

T Yu, Z Liu, P Fung - arxiv preprint arxiv:2103.11332, 2021 - arxiv.org
State-of-the-art abstractive summarization models generally rely on extensive labeled data,
which lowers their generalization ability on domains where such data are not available. In …

Curriculum learning for domain adaptation in neural machine translation

X Zhang, P Shapiro, G Kumar, P McNamee… - arxiv preprint arxiv …, 2019 - arxiv.org
We introduce a curriculum learning approach to adapt generic neural machine translation
models to a specific domain. Samples are grouped by their similarities to the domain of …

Fast domain adaptation for neural machine translation

M Freitag, Y Al-Onaizan - arxiv preprint arxiv:1612.06897, 2016 - arxiv.org
Neural Machine Translation (NMT) is a new approach for automatic translation of text from
one human language into another. The basic concept in NMT is to train a large Neural …

Variational recurrent adversarial deep domain adaptation

S Purushotham, W Carvalho, T Nilanon… - … conference on learning …, 2017 - openreview.net
We study the problem of learning domain invariant representations for time series data while
transferring the complex temporal latent dependencies between the domains. Our model …

Instance weighting for neural machine translation domain adaptation

R Wang, M Utiyama, L Liu, K Chen… - Proceedings of the 2017 …, 2017 - aclanthology.org
Instance weighting has been widely applied to phrase-based machine translation domain
adaptation. However, it is challenging to be applied to Neural Machine Translation (NMT) …