Zero-shot faithful factual error correction

KH Huang, HP Chan, H Ji - arxiv preprint arxiv:2305.07982, 2023 - arxiv.org
Faithfully correcting factual errors is critical for maintaining the integrity of textual knowledge
bases and preventing hallucinations in sequence-to-sequence models. Drawing on humans' …

[PDF][PDF] Overview of the NTCIR-17 QA Lab-PoliInfo-4 Task

Y Ogawa, Y Kimura, H Shibuki, H Ototake… - Proceedings of the …, 2023 - research.nii.ac.jp
The goal of the NTCIR-17 QA Lab-PoliInfo-4 task is to develop real-world complex question
answering (QA) techniques using Japanese political information such as local assembly …

Defining a new NLP playground

S Li, C Han, P Yu, C Edwards, M Li, X Wang… - arxiv preprint arxiv …, 2023 - arxiv.org
The recent explosion of performance of large language models (LLMs) has changed the
field of Natural Language Processing (NLP) more abruptly and seismically than any other …

Amrfact: Enhancing summarization factuality evaluation with amr-driven training data generation

H Qiu, KH Huang, J Qu, N Peng - arxiv preprint arxiv:2311.09521, 2023 - arxiv.org
Ensuring factual consistency is crucial in various natural language processing tasks,
particularly in abstractive summarization, where preserving the integrity of information is …

AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples Generation

H Qiu, KH Huang, J Qu, N Peng - … of the 2024 Conference of the …, 2024 - aclanthology.org
Ensuring factual consistency is crucial for natural language generation tasks, particularly in
abstractive summarization, where preserving the integrity of information is paramount. Prior …

Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization

CS Cheang, HP Chan, DF Wong, X Liu, Z Li… - arxiv preprint arxiv …, 2023 - arxiv.org
Recent pre-trained language models (PLMs) achieve promising results in existing
abstractive summarization datasets. However, existing summarization benchmarks overlap …

Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy

L Xu, Z Su, M Yu, J Xu, JD Choi, J Zhou… - Findings of the …, 2024 - aclanthology.org
Factual inconsistencies pose a significant hurdle for the faithful summarization by generative
models. While a major direction to enhance inconsistency detection is to derive stronger …

Improving consistency for text summarization with energy functions

Q Zeng, Q Yin, Z Li, Y Gao, S Nag, Z Wang… - Findings of the …, 2023 - aclanthology.org
Current abstractive summarization models often generate inconsistent content, ie texts that
are not directly inferable from the source document, are not consistent with respect to world …

SummaCoz: A Dataset for Improving the Interpretability of Factual Consistency Detection for Summarization

G Luo, W Fan, M Li, G Sun, R Zhang… - Findings of the …, 2024 - aclanthology.org
Summarization is an important application of Large Language Models (LLMs). When
judging the quality of a summary, factual consistency holds a significant weight. Despite …

On the Intractability to Synthesize Factual Inconsistencies in Summarization

G Luo, W Fan, M Li, Y He, Y Yang… - Findings of the …, 2024 - aclanthology.org
Factual consistency detection has gotten raised attention in the task of abstractive
summarization. Many existing works rely on synthetic training data, which may not …