A comprehensive survey on applications of transformers for deep learning tasks

S Islam, H Elmekki, A Elsebai, J Bentahar… - Expert Systems with …, 2024 - Elsevier
Abstract Transformers are Deep Neural Networks (DNN) that utilize a self-attention
mechanism to capture contextual relationships within sequential data. Unlike traditional …

On the explainability of natural language processing deep models

JE Zini, M Awad - ACM Computing Surveys, 2022 - dl.acm.org
Despite their success, deep networks are used as black-box models with outputs that are not
easily explainable during the learning and the prediction phases. This lack of interpretability …

A comprehensive survey on process-oriented automatic text summarization with exploration of llm-based methods

H **, Y Zhang, D Meng, J Wang, J Tan - arxiv preprint arxiv:2403.02901, 2024 - arxiv.org
Automatic Text Summarization (ATS), utilizing Natural Language Processing (NLP)
algorithms, aims to create concise and accurate summaries, thereby significantly reducing …

Transferable multi-domain state generator for task-oriented dialogue systems

CS Wu, A Madotto, E Hosseini-Asl, C **ong… - arxiv preprint arxiv …, 2019 - arxiv.org
Over-dependence on domain ontology and lack of knowledge sharing across domains are
two practical and yet less studied problems of dialogue state tracking. Existing approaches …

Automatic text summarization methods: A comprehensive review

G Sharma, D Sharma - SN Computer Science, 2022 - Springer
Text summarization is the process of condensing a long text into a shorter version by
maintaining the key information and its meaning. Automatic text summarization can save …

A survey of automatic text summarization: Progress, process and challenges

MF Mridha, AA Lima, K Nur, SC Das, M Hasan… - IEEE …, 2021 - ieeexplore.ieee.org
With the evolution of the Internet and multimedia technology, the amount of text data has
increased exponentially. This text volume is a precious source of information and knowledge …

A brief survey of text mining: Classification, clustering and extraction techniques

M Allahyari, S Pouriyeh, M Assefi, S Safaei… - arxiv preprint arxiv …, 2017 - arxiv.org
The amount of text that is generated every day is increasing dramatically. This tremendous
volume of mostly unstructured text cannot be simply processed and perceived by computers …

[KNYGA][B] Machine learning for text: An introduction

CC Aggarwal, CC Aggarwal - 2018 - Springer
The extraction of useful insights from text with various types of statistical algorithms is
referred to as text mining, text analytics, or machine learning from text. The choice of …

Sentiment analysis: Mining opinions, sentiments, and emotions

J Zhao, K Liu, L Xu - 2016 - direct.mit.edu
With the increasing development of Web 2.0, such as social media and online businesses,
the need for perception of opinions, attitudes, and emotions grows rapidly. Sentiment …

Neural abstractive text summarization with sequence-to-sequence models

T Shi, Y Keneshloo, N Ramakrishnan… - ACM Transactions on …, 2021 - dl.acm.org
In the past few years, neural abstractive text summarization with sequence-to-sequence
(seq2seq) models have gained a lot of popularity. Many interesting techniques have been …