This paper presents the results of the premier shared task organized alongside the
Conference on Machine Translation (WMT) 2019. Participants were asked to build machine …

This paper presents the results of the news translation task, the multilingual low-resource
translation for Indo-European languages, the triangular translation task, and the automatic …

We introduce GEM, a living benchmark for natural language Generation (NLG), its
Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving …

Traditionally, most data-to-text applications have been designed using a modular pipeline
architecture, in which non-linguistic input data is converted into natural language through …

We report results from the SR'19 Shared Task, the second edition of a multilingual surface
realisation task organised as part of the EMNLP'19 Workshop on Multilingual Surface …

This paper presents results from the Third Shared Task on Multilingual Surface Realisation
(SR'20) which was organised as part of the COLING'20 Workshop on Multilingual Surface …

Current standards for designing and reporting human evaluations in NLP mean it is
generally unclear which evaluations are comparable and can be expected to yield similar …

Generating text from graph-based data, such as Abstract Meaning Representation (AMR), is
a challenging task due to the inherent difficulty in how to properly encode the structure of a …

The neural boom that has sparked natural language processing (NLP) research throughout
the last decade has similarly led to significant innovations in data-to-text (D2T) generation …

Data-to-text generation models face challenges in ensuring data fidelity by referring to the
correct input source. To inspire studies in this area, Wiseman et al.(2017) introduced the …