Long document summarization with top-down and bottom-up inference

B Pang, E Nijkamp, W Kryściński, S Savarese… - arxiv preprint arxiv …, 2022 - arxiv.org
Text summarization aims to condense long documents and retain key information. Critical to
the success of a summarization model is the faithful inference of latent representations of …

Gretel: Graph contrastive topic enhanced language model for long document extractive summarization

Q **e, J Huang, T Saha, S Ananiadou - arxiv preprint arxiv:2208.09982, 2022 - arxiv.org
Recently, neural topic models (NTMs) have been incorporated into pre-trained language
models (PLMs), to capture the global semantic information for text summarization. However …

Sparsity in transformers: A systematic literature review

M Farina, U Ahmad, A Taha, H Younes, Y Mesbah… - Neurocomputing, 2024 - Elsevier
Transformers have become the state-of-the-art architectures for various tasks in Natural
Language Processing (NLP) and Computer Vision (CV); however, their space and …

Exploring neural models for query-focused summarization

J Vig, AR Fabbri, W Kryściński, CS Wu… - arxiv preprint arxiv …, 2021 - arxiv.org
Query-focused summarization (QFS) aims to produce summaries that answer particular
questions of interest, enabling greater user control and personalization. While recently …

Summarizing legal regulatory documents using transformers

S Klaus, R Van Hecke, K Djafari Naini… - Proceedings of the 45th …, 2022 - dl.acm.org
Companies invest a substantial amount of time and resources in ensuring the compliance to
the existing regulations or in the form of fines when compliance cannot be proven in auditing …

Incorporating distributions of discourse structure for long document abstractive summarization

D Pu, Y Wang, V Demberg - arxiv preprint arxiv:2305.16784, 2023 - arxiv.org
For text summarization, the role of discourse structure is pivotal in discerning the core
content of a text. Regrettably, prior studies on incorporating Rhetorical Structure Theory …

Improving extractive summarization with semantic enhancement through topic-injection based BERT model

Y Wang, J Zhang, Z Yang, B Wang, J **… - Information Processing & …, 2024 - Elsevier
In the field of text summarization, extractive techniques aim to extract key sentences from a
document to form a summary. However, traditional methods are not sensitive enough to …

Noise-injected consistency training and entropy-constrained pseudo labeling for semi-supervised extractive summarization

Y Wang, Q Mao, J Liu, W Jiang, H Zhu… - Proceedings of the 29th …, 2022 - aclanthology.org
Labeling large amounts of extractive summarization data is often prohibitive expensive due
to time, financial, and expertise constraints, which poses great challenges to incorporating …

Hettreesum: A heterogeneous tree structure-based extractive summarization model for scientific papers

J Zhao, L Yang, X Cai - Expert Systems with Applications, 2022 - Elsevier
Scientific paper summarization aims at generating a short and concise digest while
preserving important information of the original document. Currently, scientific paper …

[Retracted] N‐GPETS: Neural Attention Graph‐Based Pretrained Statistical Model for Extractive Text Summarization

M Umair, I Alam, A Khan, I Khan, N Ullah… - Computational …, 2022 - Wiley Online Library
The extractive summarization approach involves selecting the source document's salient
sentences to build a summary. One of the most important aspects of extractive …