Analysis methods in neural language processing: A survey

Y Belinkov, J Glass - … of the Association for Computational Linguistics, 2019 - direct.mit.edu
The field of natural language processing has seen impressive progress in recent years, with
neural network models replacing many of the traditional systems. A plethora of new models …

Neural machine translation: A review

F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …

Document-level machine translation with large language models

L Wang, C Lyu, T Ji, Z Zhang, D Yu, S Shi… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant,
and fluent answers for various natural language processing (NLP) tasks. Taking document …

Evaluating gender bias in machine translation

G Stanovsky, NA Smith, L Zettlemoyer - arxiv preprint arxiv:1906.00591, 2019 - arxiv.org
We present the first challenge set and evaluation protocol for the analysis of gender bias in
machine translation (MT). Our approach uses two recent coreference resolution datasets …

Competence-based curriculum learning for neural machine translation

EA Platanios, O Stretcu, G Neubig, B Poczos… - arxiv preprint arxiv …, 2019 - arxiv.org
Current state-of-the-art NMT systems use large neural networks that are not only slow to
train, but also often require many heuristics and optimization tricks, such as specialized …

Stress test evaluation for natural language inference

A Naik, A Ravichander, N Sadeh, C Rose… - arxiv preprint arxiv …, 2018 - arxiv.org
Natural language inference (NLI) is the task of determining if a natural language hypothesis
can be inferred from a given premise in a justifiable manner. NLI was proposed as a …

Document-level neural machine translation with hierarchical attention networks

L Miculicich, D Ram, N Pappas… - arxiv preprint arxiv …, 2018 - arxiv.org
Neural Machine Translation (NMT) can be improved by including document-level contextual
information. For this purpose, we propose a hierarchical attention model to capture the …

Context-aware neural machine translation learns anaphora resolution

E Voita, P Serdyukov, R Sennrich, I Titov - arxiv preprint arxiv:1805.10163, 2018 - arxiv.org
Standard machine translation systems process sentences in isolation and hence ignore
extra-sentential information, even though extended context can both prevent mistakes in …

Improving the transformer translation model with document-level context

J Zhang, H Luan, M Sun, F Zhai, J Xu, M Zhang… - arxiv preprint arxiv …, 2018 - arxiv.org
Although the Transformer translation model (Vaswani et al., 2017) has achieved state-of-the-
art performance in a variety of translation tasks, how to use document-level context to deal …

When a good translation is wrong in context: Context-aware machine translation improves on deixis, ellipsis, and lexical cohesion

E Voita, R Sennrich, I Titov - arxiv preprint arxiv:1905.05979, 2019 - arxiv.org
Though machine translation errors caused by the lack of context beyond one sentence have
long been acknowledged, the development of context-aware NMT systems is hampered by …