The challenging task of summary evaluation: an overview

E Lloret, L Plaza, A Aker - Language Resources and Evaluation, 2018 - Springer
Abstract Evaluation is crucial in the research and development of automatic summarization
applications, in order to determine the appropriateness of a summary based on different …

[KİTAP][B] Automatic text summarization

JM Torres-Moreno - 2014 - books.google.com
Textual information in the form of digital documents quickly accumulates to create huge
amounts of data. The majority of these documents are unstructured: it is unrestricted text and …

Summtriver: A new trivergent model to evaluate summaries automatically without human references

LA Cabrera-Diego, JM Torres-Moreno - Data & Knowledge Engineering, 2018 - Elsevier
The automatic evaluation of summaries is a hard task that continues to be open. The
assessment aims to measure simultaneously the informativeness and readability of …

Enhancing N-Gram based metrics with semantics for better evaluation of abstractive text summarization

JW He, WJ Jiang, GB Chen, YQ Le, XF Ding - Journal of Computer …, 2022 - Springer
Text summarization is an important task in natural language processing and it has been
applied in many applications. Recently, abstractive summarization has attracted many …

HybridEval: An Improved Novel Hybrid Metric for Evaluation of Text Summarization

R Sarwar, B Ahmad, PS Teh, S Tuarob… - Journal of Informatics …, 2024 - mmupress.com
The present work re-evaluates the evaluation method for text summarization tasks. Two state-
of-the-art assessment measures eg, Recall-Oriented Understudy for Gisting Evaluation …

Towards a reliable and robust methodology for crowd-based subjective quality assessment of query-based extractive text summarization

N Iskender, T Polzehl, S Möller - Proceedings of the Twelfth …, 2020 - aclanthology.org
The intrinsic and extrinsic quality evaluation is an essential part of the summary evaluation
methodology usually conducted in a traditional controlled laboratory environment. However …

Multitask summary scoring with longformers

RM Botarleanu, M Dascalu, LK Allen… - … Conference on Artificial …, 2022 - Springer
Automated scoring of student language is a complex task that requires systems to emulate
complex and multi-faceted human evaluation criteria. Summary scoring brings an additional …

Calculating the upper bounds for multi-document summarization using genetic algorithms

J Rojas Simón, Y Ledeneva… - Computación y …, 2018 - scielo.org.mx
Over the last years, several Multi-Document Summarization (MDS) methods have been
presented in Document Understanding Conference (DUC), workshops. Since DUC01 …

NoteSum: An integrated note summarization system by using text mining algorithms

HC Wang, WF Chen, CY Lin - Information Sciences, 2020 - Elsevier
This study implemented an integrated system of Note Summarization (NoteSum) that
merged with multi-users' notes and searched for relevant information on the Internet and …

Overview of the inex 2010 question answering track (qa@ inex)

E SanJuan, P Bellot, V Moriceau, X Tannier - International Workshop of the …, 2010 - Springer
Abstract The INEX Question Answering track (QA@ INEX) aims to evaluate a complex
question-answering task using the Wikipedia. The set of questions is composed of factoid …