Translation quality assessment: A brief survey on manual and automatic methods

L Han, GJF Jones, AF Smeaton - arxiv preprint arxiv:2105.03311, 2021‏ - arxiv.org
To facilitate effective translation modeling and translation studies, one of the crucial
questions to address is how to assess translation quality. From the perspectives of accuracy …

An overview on machine translation evaluation

L Han - arxiv preprint arxiv:2202.11027, 2022‏ - arxiv.org
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and
development, and has experienced several different periods and stages of development …

[PDF][PDF] Blend: a novel combined MT metric based on direct assessment—CASICT-DCU submission to WMT17 metrics task

Q Ma, Y Graham, S Wang, Q Liu - Proceedings of the second …, 2017‏ - aclanthology.org
Existing metrics to evaluate the quality of Machine Translation hypotheses take different
perspectives into account. DPM-Fcomb, a metric combining the merits of a range of metrics …

[كتاب][B] Syntax-based statistical machine translation

P Williams, R Sennrich, M Post, P Koehn - 2016‏ - Springer
This unique book provides a comprehensive introduction to the most popular syntax-based
statistical machine translation models, filling a gap in the current literature for researchers …

Machine translation evaluation resources and methods: A survey

L Han - arxiv preprint arxiv:1605.04515, 2016‏ - arxiv.org
We introduce the Machine Translation (MT) evaluation survey that contains both manual and
automatic evaluation methods. The traditional human evaluation criteria mainly include the …

[PDF][PDF] CASICT-DCU participation in WMT2015 metrics task

H Yu, Q Ma, X Wu, Q Liu - Proceedings of the Tenth Workshop on …, 2015‏ - aclanthology.org
Human-designed sub-structures are required by most of the syntax-based machine
translation evaluation metrics. In this paper, we propose a novel evaluation metric based on …

[PDF][PDF] BEER 1.1: ILLC UvA submission to metrics and tuning task

M Stanojević, K Sima'an - Proceedings of the Tenth Workshop on …, 2015‏ - aclanthology.org
We describe the submissions of ILLC UvA to the metrics and tuning tasks on WMT15. Both
submissions are based on the BEER evaluation metric originally presented on WMT14 …

Otem&Utem: Over-and under-translation evaluation metric for NMT

J Yang, B Zhang, Y Qin, X Zhang, Q Lin… - … Language Processing and …, 2018‏ - Springer
Although neural machine translation (NMT) yields promising translation performance, it
unfortunately suffers from over-and under-translation issues [31], of which studies have …

Incorporate semantic structures into machine translation evaluation via UCCA

J Xu, Y Guo, J Hu - arxiv preprint arxiv:2010.08728, 2020‏ - arxiv.org
Copying mechanism has been commonly used in neural paraphrasing networks and other
text generation tasks, in which some important words in the input sequence are preserved in …

An automatic machine translation evaluation metric based on dependency parsing model

H Yu, X Wu, W Jiang, Q Liu, S Lin - arxiv preprint arxiv:1508.01996, 2015‏ - arxiv.org
Most of the syntax-based metrics obtain the similarity by comparing the sub-structures
extracted from the trees of hypothesis and reference. These sub-structures are defined by …