Grammatical error correction: A survey of the state of the art

C Bryant, Z Yuan, MR Qorib, H Cao, HT Ng… - Computational …, 2023 - direct.mit.edu
Abstract Grammatical Error Correction (GEC) is the task of automatically detecting and
correcting errors in text. The task not only includes the correction of grammatical errors, such …

[HTML][HTML] Human evaluation of automatically generated text: Current trends and best practice guidelines

C van der Lee, A Gatt, E van Miltenburg… - Computer Speech & …, 2021 - Elsevier
Currently, there is little agreement as to how Natural Language Generation (NLG) systems
should be evaluated, with a particularly high degree of variation in the way that human …

The BEA-2019 shared task on grammatical error correction

C Bryant, M Felice, ØE Andersen… - Proceedings of the …, 2019 - aclanthology.org
This paper reports on the BEA-2019 Shared Task on Grammatical Error Correction (GEC).
As with the CoNLL-2014 shared task, participants are required to correct all types of errors in …

MuCGEC: a multi-reference multi-source evaluation dataset for Chinese grammatical error correction

Y Zhang, Z Li, Z Bao, J Li, B Zhang, C Li… - arxiv preprint arxiv …, 2022 - arxiv.org
This paper presents MuCGEC, a multi-reference multi-source evaluation dataset for Chinese
Grammatical Error Correction (CGEC), consisting of 7,063 sentences collected from three …

A comprehensive survey of grammatical error correction

Y Wang, Y Wang, K Dang, J Liu, Z Liu - ACM Transactions on Intelligent …, 2021 - dl.acm.org
Grammatical error correction (GEC) is an important application aspect of natural language
processing techniques, and GEC system is a kind of very important intelligent system that …

Efficient benchmarking (of language models)

Y Perlitz, E Bandel, A Gera, O Arviv, L Ein-Dor… - arxiv preprint arxiv …, 2023 - arxiv.org
The increasing versatility of language models LMs has given rise to a new class of
benchmarks that comprehensively assess a broad range of capabilities. Such benchmarks …

Grammar error correction in morphologically rich languages: The case of Russian

A Rozovskaya, D Roth - Transactions of the Association for …, 2019 - direct.mit.edu
Until now, most of the research in grammar error correction focused on English, and the
problem has hardly been explored for other languages. We address the task of correcting …

Reaching human-level performance in automatic grammatical error correction: An empirical study

T Ge, F Wei, M Zhou - arxiv preprint arxiv:1807.01270, 2018 - arxiv.org
Neural sequence-to-sequence (seq2seq) approaches have proven to be successful in
grammatical error correction (GEC). Based on the seq2seq framework, we propose a novel …

The grammar-learning trajectories of neural language models

L Choshen, G Hacohen, D Weinshall… - arxiv preprint arxiv …, 2021 - arxiv.org
The learning trajectories of linguistic phenomena in humans provide insight into linguistic
representation, beyond what can be gleaned from inspecting the behavior of an adult …

Dancing between success and failure: Edit-level simplification evaluation using SALSA

D Heineman, Y Dou, M Maddela, W Xu - arxiv preprint arxiv:2305.14458, 2023 - arxiv.org
Large language models (eg, GPT-4) are uniquely capable of producing highly rated text
simplification, yet current human evaluation methods fail to provide a clear understanding of …