Pre-trained models for natural language processing: A survey
Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …
Deep reinforcement and transfer learning for abstractive text summarization: A review
Abstract Automatic Text Summarization (ATS) is an important area in Natural Language
Processing (NLP) with the goal of shortening a long text into a more compact version by …
Processing (NLP) with the goal of shortening a long text into a more compact version by …
Bartscore: Evaluating generated text as text generation
A wide variety of NLP applications, such as machine translation, summarization, and dialog,
involve text generation. One major challenge for these applications is how to evaluate …
involve text generation. One major challenge for these applications is how to evaluate …
Towards a unified multi-dimensional evaluator for text generation
Multi-dimensional evaluation is the dominant paradigm for human evaluation in Natural
Language Generation (NLG), ie, evaluating the generated text from multiple explainable …
Language Generation (NLG), ie, evaluating the generated text from multiple explainable …
Pegasus: Pre-training with extracted gap-sentences for abstractive summarization
Recent work pre-training Transformers with self-supervised objectives on large text corpora
has shown great success when fine-tuned on downstream NLP tasks including text …
has shown great success when fine-tuned on downstream NLP tasks including text …
Extractive summarization as text matching
This paper creates a paradigm shift with regard to the way we build neural extractive
summarization systems. Instead of following the commonly used framework of extracting …
summarization systems. Instead of following the commonly used framework of extracting …
QMSum: A new benchmark for query-based multi-domain meeting summarization
Meetings are a key component of human collaboration. As increasing numbers of meetings
are recorded and transcribed, meeting summaries have become essential to remind those …
are recorded and transcribed, meeting summaries have become essential to remind those …
Heterogeneous graph neural networks for extractive document summarization
As a crucial step in extractive document summarization, learning cross-sentence relations
has been explored by a plethora of approaches. An intuitive way is to put them in the graph …
has been explored by a plethora of approaches. An intuitive way is to put them in the graph …
Discourse-aware neural extractive text summarization
Recently BERT has been adopted for document encoding in state-of-the-art text
summarization models. However, sentence-based extractive models often result in …
summarization models. However, sentence-based extractive models often result in …
Re-evaluating evaluation in text summarization
Automated evaluation metrics as a stand-in for manual evaluation are an essential part of
the development of text-generation tasks such as text summarization. However, while the …
the development of text-generation tasks such as text summarization. However, while the …