compare-mt: A tool for holistic comparison of language generation systems

G Neubig, ZY Dou, J Hu, P Michel, D Pruthi… - arxiv preprint arxiv …, 2019 - arxiv.org
In this paper, we describe compare-mt, a tool for holistic analysis and comparison of the
results of systems for language generation tasks such as machine translation. The main goal …

Error classification and analysis for machine translation quality assessment

M Popović - Translation quality assessment: From principles to …, 2018 - Springer
This chapter presents an overview of different approaches and tasks related to classification
and analysis of errors in machine translation (MT) output. Manual error classification is a …

Explainaboard: An explainable leaderboard for nlp

P Liu, J Fu, Y **ao, W Yuan, S Chang, J Dai… - arxiv preprint arxiv …, 2021 - arxiv.org
With the rapid development of NLP research, leaderboards have emerged as one tool to
track the performance of various systems on various NLP tasks. They are effective in this …

Statistical machine translation enhancements through linguistic levels: A survey

MR Costa-Jussá, M Farrús - ACM Computing Surveys (CSUR), 2014 - dl.acm.org
Machine translation can be considered a highly interdisciplinary and multidisciplinary field
because it is approached from the point of view of human translators, engineers, computer …

Measuring difficulty in translation and post-editing: A review

S Sun - Researching cognitive processes of translation, 2019 - Springer
Difficulty (or called mental load, cognitive effort) has been an importance topic in translation
and interpreting process research. This article first clarifies conceptual issues and reviews …

Evaluating the morphological competence of machine translation systems

F Burlot, F Yvon - 2nd Conference on Machine Translation (WMT17), 2017 - hal.science
While recent changes in Machine Translation state-of-the-art brought translation quality a
step further, it is regularly acknowledged that the standard automatic metrics do not provide …

[PDF][PDF] On the practice of error analysis for machine translation evaluation.

S Stymne, L Ahrenberg - LREC, 2012 - Citeseer
Error analysis is a means to assess machine translation output in qualitative terms, which
can be used as a basis for the generation of error profiles for different systems. As for other …

Machine Translation Quality: A comparative evaluation of SMT, NMT and tailored-NMT outputs

M Stasimioti, V Sosoni, KL Kermanidis… - Proceedings of the …, 2020 - aclanthology.org
The present study aims to compare three systems: a generic statistical machine translation
(SMT), a generic neural machine translation (NMT) and a tailored-NMT system focusing on …

Addicter: what is wrong with my translations?

D Zeman, M Fishel, J Berka, O Bojar - The Prague Bulletin of …, 2011 - zora.uzh.ch
We introduce Addicter, a tool for Automatic Detection and DIsplay of Common Translation
ERrors. The tool allows to automatically identify and label translation errors and browse the …