Advances in the field of machine translation have recently generated new interest in the use
of this technology in various scenarios. This development raises questions over the roles of …

To facilitate effective translation modeling and translation studies, one of the crucial
questions to address is how to assess translation quality. From the perspectives of accuracy …

This paper presents the results of the premier shared task organized alongside the
Conference on Machine Translation (WMT) 2019. Participants were asked to build machine …

This paper presents the results of the WMT17 shared tasks, which included three machine
translation (MT) tasks (news, biomedical, and multimodal), two evaluation tasks (metrics and …

State-of-the-art named entity recognition systems rely heavily on hand-crafted features and
domain-specific knowledge in order to learn effectively from the small, supervised training …

We investigate evaluation metrics for dialogue response generation systems where
supervised labels, such as task completion, are not available. Recent works in response …

This paper presents the results of the WMT16 shared tasks, which included five machine
translation (MT) tasks (standard news, IT-domain, biomedical, multimodal, pronoun), three …

This paper presents the results of the news translation task, the multilingual low-resource
translation for Indo-European languages, the triangular translation task, and the automatic …

This paper presents the results of the WMT14 shared tasks, which included a standard news
translation task, a separate medical translation task, a task for run-time estimation of …

Non-expert annotation services like Amazon's Mechanical Turk (AMT) are cheap and fast
ways to evaluate systems and provide categorical annotations for training data …