Neural extractive text summarization with syntactic compression

J Xu, G Durrett - arxiv preprint arxiv:1902.00863, 2019 - arxiv.org
Recent neural network approaches to summarization are largely either selection-based
extraction or generation-based abstraction. In this work, we present a neural model for …

Do syntax trees help pre-trained transformers extract information?

DS Sachan, Y Zhang, P Qi, W Hamilton - arxiv preprint arxiv:2008.09084, 2020 - arxiv.org
Much recent work suggests that incorporating syntax information from dependency trees can
improve task-specific transformer models. However, the effect of incorporating dependency …

Non-autoregressive text generation with pre-trained language models

Y Su, D Cai, Y Wang, D Vandyke, S Baker, P Li… - arxiv preprint arxiv …, 2021 - arxiv.org
Non-autoregressive generation (NAG) has recently attracted great attention due to its fast
inference speed. However, the generation quality of existing NAG models still lags behind …

Logparse: Making log parsing adaptive through word classification

W Meng, Y Liu, F Zaiter, S Zhang… - 2020 29th …, 2020 - ieeexplore.ieee.org
Logs are one of the most valuable data sources for large-scale service (eg, social network,
search engine) maintenance. Log parsing serves as the the first step towards automated log …

Transformers-based information extraction with limited data for domain-specific business documents

MT Nguyen, DT Le, L Le - Engineering Applications of Artificial Intelligence, 2021 - Elsevier
Abstract Information extraction plays an important role for data transformation in business
cases. However, building extraction systems in actual cases face two challenges:(i) the …

A language model based evaluator for sentence compression

Y Zhao, Z Luo, A Aizawa - … of the 56th Annual Meeting of the …, 2018 - aclanthology.org
We herein present a language-model-based evaluator for deletion-based sentence
compression and view this task as a series of deletion-and-evaluation operations using the …

SATS: simplification aware text summarization of scientific documents

F Zaman, F Kamiran, M Shardlow… - Frontiers in Artificial …, 2024 - frontiersin.org
Simplifying summaries of scholarly publications has been a popular method for conveying
scientific discoveries to a broader audience. While text summarization aims to shorten long …

Efficient unsupervised sentence compression by fine-tuning transformers with reinforcement learning

DG Ghalandari, C Hokamp, G Ifrim - arxiv preprint arxiv:2205.08221, 2022 - arxiv.org
Sentence compression reduces the length of text by removing non-essential content while
preserving important facts and grammaticality. Unsupervised objective driven methods for …

An optimized abstractive text summarization model using peephole convolutional LSTM

MM Rahman, FH Siddiqui - Symmetry, 2019 - mdpi.com
Abstractive text summarization that generates a summary by paraphrasing a long text
remains an open significant problem for natural language processing. In this paper, we …

Syntactically look-ahead attention network for sentence compression

H Kamigaito, M Okumura - Proceedings of the AAAI Conference on Artificial …, 2020 - aaai.org
Sentence compression is the task of compressing a long sentence into a short one by
deleting redundant words. In sequence-to-sequence (Seq2Seq) based models, the decoder …