Extractive summarization of long documents by combining global and local context

W **ao, G Carenini - arxiv preprint arxiv:1909.08089, 2019 - arxiv.org
In this paper, we propose a novel neural single document extractive summarization model
for long documents, incorporating both the global context of the whole document and the …

Globalizing BERT-based transformer architectures for long document summarization

Q Grail, J Perez, E Gaussier - … of the 16th conference of the …, 2021 - aclanthology.org
Fine-tuning a large language model on downstream tasks has become a commonly adopted
process in the Natural Language Processing (NLP)(CITATION). However, such a process …

SECTOR: A neural model for coherent topic segmentation and classification

S Arnold, R Schneider, P Cudré-Mauroux… - Transactions of the …, 2019 - direct.mit.edu
When searching for information, a human reader first glances over a document, spots
relevant sections, and then focuses on a few sentences for resolving her intention. However …

Text segmentation by cross segment attention

M Lukasik, B Dadachev, G Simoes… - arxiv preprint arxiv …, 2020 - arxiv.org
Document and discourse segmentation are two fundamental NLP tasks pertaining to
breaking up text into constituents, which are commonly used to help downstream tasks such …

Improving unsupervised dialogue topic segmentation with utterance-pair coherence scoring

L **ng, G Carenini - arxiv preprint arxiv:2106.06719, 2021 - arxiv.org
Dialogue topic segmentation is critical in several dialogue modeling problems. However,
popular unsupervised approaches only exploit surface features in assessing topical …

A two-stage transformer-based approach for variable-length abstractive summarization

MH Su, CH Wu, HT Cheng - IEEE/ACM Transactions on Audio …, 2020 - ieeexplore.ieee.org
This study proposes a two-stage method for variable-length abstractive summarization. This
is an improvement over previous models, in that the proposed approach can simultaneously …

Discourse as a function of event: Profiling discourse structure in news articles around the main event

PK Choubey, A Lee, R Huang, L Wang - … of the 58th Annual Meeting of …, 2020 - par.nsf.gov
Understanding discourse structures of news articles is vital to effectively contextualize the
occurrence of a news event. To enable computational modeling of news structures, we apply …

Transformer over pre-trained transformer for neural text segmentation with enhanced topic coherence

K Lo, Y **, W Tan, M Liu, L Du, W Buntine - arxiv preprint arxiv …, 2021 - arxiv.org
This paper proposes a transformer over transformer framework, called Transformer $^ 2$, to
perform neural text segmentation. It consists of two components: bottom-level sentence …

A joint model for document segmentation and segment labeling

J Barrow, R Jain, V Morariu, V Manjunatha… - Proceedings of the …, 2020 - aclanthology.org
Text segmentation aims to uncover latent structure by dividing text from a document into
coherent sections. Where previous work on text segmentation considers the tasks of …

Document modeling with graph attention networks for multi-grained machine reading comprehension

B Zheng, H Wen, Y Liang, N Duan, W Che… - arxiv preprint arxiv …, 2020 - arxiv.org
Natural Questions is a new challenging machine reading comprehension benchmark with
two-grained answers, which are a long answer (typically a paragraph) and a short answer …