[HTML][HTML] Deep learning attention mechanism in medical image analysis: Basics and beyonds

X Li, M Li, P Yan, G Li, Y Jiang, H Luo… - International Journal of …, 2023 - sciltp.com
With the improvement of hardware computing power and the development of deep learning
algorithms, a revolution of" artificial intelligence (AI)+ medical image" is taking place …

Attention mechanisms in computer vision: A survey

MH Guo, TX Xu, JJ Liu, ZN Liu, PT Jiang, TJ Mu… - Computational visual …, 2022 - Springer
Humans can naturally and effectively find salient regions in complex scenes. Motivated by
this observation, attention mechanisms were introduced into computer vision with the aim of …

Towards large-scale small object detection: Survey and benchmarks

G Cheng, X Yuan, X Yao, K Yan, Q Zeng… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
With the rise of deep convolutional neural networks, object detection has achieved
prominent advances in past years. However, such prosperity could not camouflage the …

The impact of the human thalamus on brain-wide information processing

JM Shine, LD Lewis, DD Garrett… - Nature Reviews …, 2023 - nature.com
The thalamus is a small, bilateral structure in the diencephalon that integrates signals from
many areas of the CNS. This critical anatomical position allows the thalamus to influence …

Simam: A simple, parameter-free attention module for convolutional neural networks

L Yang, RY Zhang, L Li, X **e - International conference on …, 2021 - proceedings.mlr.press
In this paper, we propose a conceptually simple but very effective attention module for
Convolutional Neural Networks (ConvNets). In contrast to existing channel-wise and spatial …

Fine-grained image analysis with deep learning: A survey

XS Wei, YZ Song, O Mac Aodha, J Wu… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer
vision and pattern recognition, and underpins a diverse set of real-world applications. The …

The role of PFC networks in cognitive control and executive function

V Menon, M D'Esposito - Neuropsychopharmacology, 2022 - nature.com
Abstract Systems neuroscience approaches with a focus on large-scale brain organization
and network analysis are advancing foundational knowledge of how cognitive control …

A review on the attention mechanism of deep learning

Z Niu, G Zhong, H Yu - Neurocomputing, 2021 - Elsevier
Attention has arguably become one of the most important concepts in the deep learning
field. It is inspired by the biological systems of humans that tend to focus on the distinctive …

Attention mechanism in neural networks: where it comes and where it goes

D Soydaner - Neural Computing and Applications, 2022 - Springer
A long time ago in the machine learning literature, the idea of incorporating a mechanism
inspired by the human visual system into neural networks was introduced. This idea is …

State-dependent effects of neural stimulation on brain function and cognition

C Bradley, AS Nydam, PE Dux… - Nature Reviews …, 2022 - nature.com
Invasive and non-invasive brain stimulation methods are widely used in neuroscience to
establish causal relationships between distinct brain regions and the sensory, cognitive and …