A review on the attention mechanism of deep learning

Z Niu, G Zhong, H Yu - Neurocomputing, 2021 - Elsevier
Attention has arguably become one of the most important concepts in the deep learning
field. It is inspired by the biological systems of humans that tend to focus on the distinctive …

Attention in natural language processing

A Galassi, M Lippi, P Torroni - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …

A general survey on attention mechanisms in deep learning

G Brauwers, F Frasincar - IEEE Transactions on Knowledge …, 2021 - ieeexplore.ieee.org
Attention is an important mechanism that can be employed for a variety of deep learning
models across many different domains and tasks. This survey provides an overview of the …

Explainable deep learning: A field guide for the uninitiated

G Ras, N **e, M Van Gerven, D Doran - Journal of Artificial Intelligence …, 2022 - jair.org
Deep neural networks (DNNs) are an indispensable machine learning tool despite the
difficulty of diagnosing what aspects of a model's input drive its decisions. In countless real …

Large language models (LLMs): survey, technical frameworks, and future challenges

P Kumar - Artificial Intelligence Review, 2024 - Springer
Artificial intelligence (AI) has significantly impacted various fields. Large language models
(LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have …

Linking exploits from the dark web to known vulnerabilities for proactive cyber threat intelligence: An attention-based deep structured semantic model1

S Samtani, Y Chai, H Chen - MIS quarterly, 2022 - par.nsf.gov
Black hat hackers use malicious exploits to circumvent security controls and take advantage
of system vulnerabilities worldwide, costing the global economy over $450 billion annually …

Goal-guided transformer-enabled reinforcement learning for efficient autonomous navigation

W Huang, Y Zhou, X He, C Lv - IEEE Transactions on Intelligent …, 2023 - ieeexplore.ieee.org
Despite some successful applications of goal-driven navigation, existing deep reinforcement
learning (DRL)-based approaches notoriously suffers from poor data efficiency issue. One of …

OViTAD: Optimized vision transformer to predict various stages of Alzheimer's disease using resting-state fMRI and structural MRI data

S Sarraf, A Sarraf, DD DeSouza, JAE Anderson… - Brain sciences, 2023 - mdpi.com
Advances in applied machine learning techniques for neuroimaging have encouraged
scientists to implement models to diagnose brain disorders such as Alzheimer's disease at …

[SÁCH][B] Transformers for machine learning: a deep dive

U Kamath, K Graham, W Emara - 2022 - taylorfrancis.com
Transformers are becoming a core part of many neural network architectures, employed in a
wide range of applications such as NLP, Speech Recognition, Time Series, and Computer …

-FKG: Attentive Attribute-Aware Fashion Knowledge Graph for Outfit Preference Prediction

H Zhan, J Lin, KE Ak, B Shi, LY Duan… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
With the booming development of the online fashion industry, effective personalized
recommender systems have become indispensable for the convenience they brought to the …