Extractive summarization of long documents by combining global and local context
In this paper, we propose a novel neural single document extractive summarization model
for long documents, incorporating both the global context of the whole document and the …
for long documents, incorporating both the global context of the whole document and the …
Globalizing BERT-based transformer architectures for long document summarization
Fine-tuning a large language model on downstream tasks has become a commonly adopted
process in the Natural Language Processing (NLP)(CITATION). However, such a process …
process in the Natural Language Processing (NLP)(CITATION). However, such a process …
SECTOR: A neural model for coherent topic segmentation and classification
When searching for information, a human reader first glances over a document, spots
relevant sections, and then focuses on a few sentences for resolving her intention. However …
relevant sections, and then focuses on a few sentences for resolving her intention. However …
Text segmentation by cross segment attention
Document and discourse segmentation are two fundamental NLP tasks pertaining to
breaking up text into constituents, which are commonly used to help downstream tasks such …
breaking up text into constituents, which are commonly used to help downstream tasks such …
Improving unsupervised dialogue topic segmentation with utterance-pair coherence scoring
Dialogue topic segmentation is critical in several dialogue modeling problems. However,
popular unsupervised approaches only exploit surface features in assessing topical …
popular unsupervised approaches only exploit surface features in assessing topical …
A two-stage transformer-based approach for variable-length abstractive summarization
This study proposes a two-stage method for variable-length abstractive summarization. This
is an improvement over previous models, in that the proposed approach can simultaneously …
is an improvement over previous models, in that the proposed approach can simultaneously …
Discourse as a function of event: Profiling discourse structure in news articles around the main event
Understanding discourse structures of news articles is vital to effectively contextualize the
occurrence of a news event. To enable computational modeling of news structures, we apply …
occurrence of a news event. To enable computational modeling of news structures, we apply …
Transformer over pre-trained transformer for neural text segmentation with enhanced topic coherence
This paper proposes a transformer over transformer framework, called Transformer $^ 2$, to
perform neural text segmentation. It consists of two components: bottom-level sentence …
perform neural text segmentation. It consists of two components: bottom-level sentence …
A joint model for document segmentation and segment labeling
Text segmentation aims to uncover latent structure by dividing text from a document into
coherent sections. Where previous work on text segmentation considers the tasks of …
coherent sections. Where previous work on text segmentation considers the tasks of …
Document modeling with graph attention networks for multi-grained machine reading comprehension
Natural Questions is a new challenging machine reading comprehension benchmark with
two-grained answers, which are a long answer (typically a paragraph) and a short answer …
two-grained answers, which are a long answer (typically a paragraph) and a short answer …