The field of natural language processing has seen impressive progress in recent years, with
neural network models replacing many of the traditional systems. A plethora of new models …

Recognizing Textual Entailment (RTE) was proposed as a unified evaluation framework to
compare semantic understanding of different NLP systems. In this survey paper, we provide …

There is a tendency across different subfields in AI to valorize a small collection of influential
benchmarks. These benchmarks operate as stand-ins for a range of anointed common …

Annotators' disagreement in linguistic data has been recently the focus of multiple initiatives
aimed at raising awareness on issues related to 'majority voting'when aggregating diverging …

We describe an annotation scheme and a tool developed for creating linguistically
annotated corpora for non-configurational languages. Since the requirements for such a …

This document describes a sizable grammar of English written in the TAG formalism and
implemented for use with the XTAG system. This report and the grammar described herein …

We present a critical overview of the state-of-the-art in parser evaluation methodologies and
metrics. A discussion of their relative strengths and weaknesses motivates a new—and we …

In this paper, we report an analysis of the strengths and weaknesses of several Machine
Translation (MT) engines implementing the three most widely used paradigms. The analysis …

Since its inception in the mid-eighties, the field of construction grammar has been steadily
growing and constructionist approaches to language have by now become a mainstream …

While recent changes in Machine Translation state-of-the-art brought translation quality a
step further, it is regularly acknowledged that the standard automatic metrics do not provide …