Attention mechanisms in computer vision: A survey

MH Guo, TX Xu, JJ Liu, ZN Liu, PT Jiang, TJ Mu… - Computational visual …, 2022 - Springer
Humans can naturally and effectively find salient regions in complex scenes. Motivated by
this observation, attention mechanisms were introduced into computer vision with the aim of …

[HTML][HTML] Review of image classification algorithms based on convolutional neural networks

L Chen, S Li, Q Bai, J Yang, S Jiang, Y Miao - Remote Sensing, 2021 - mdpi.com
Image classification has always been a hot research direction in the world, and the
emergence of deep learning has promoted the development of this field. Convolutional …

Efficient multi-scale attention module with cross-spatial learning

D Ouyang, S He, G Zhang, M Luo… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
Remarkable effectiveness of the channel or spatial attention mechanisms for producing
more discernible feature representation are illustrated in various computer vision tasks …

Large selective kernel network for remote sensing object detection

Y Li, Q Hou, Z Zheng, MM Cheng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent research on remote sensing object detection has largely focused on improving the
representation of oriented bounding boxes but has overlooked the unique prior knowledge …

Scconv: Spatial and channel reconstruction convolution for feature redundancy

J Li, Y Wen, L He - … of the IEEE/CVF conference on …, 2023 - openaccess.thecvf.com
Abstract Convolutional Neural Networks (CNNs) have achieved remarkable performance in
various computer vision tasks but this comes at the cost of tremendous computational …

Designing network design strategies through gradient path analysis

CY Wang, HYM Liao, IH Yeh - arxiv preprint arxiv:2211.04800, 2022 - arxiv.org
Designing a high-efficiency and high-quality expressive network architecture has always
been the most important research topic in the field of deep learning. Most of today's network …

BL-YOLOv8: An improved road defect detection model based on YOLOv8

X Wang, H Gao, Z Jia, Z Li - Sensors, 2023 - mdpi.com
Road defect detection is a crucial task for promptly repairing road damage and ensuring
road safety. Traditional manual detection methods are inefficient and costly. To overcome …

Large separable kernel attention: Rethinking the large kernel attention design in cnn

KW Lau, LM Po, YAU Rehman - Expert Systems with Applications, 2024 - Elsevier
Abstract Visual Attention Networks (VAN) with Large Kernel Attention (LKA) modules have
been shown to provide remarkable performance, that surpasses Vision Transformers (ViTs) …

TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution

Y **ao, Q Yuan, K Jiang, J He, CW Lin… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Transformer-based method has demonstrated promising performance in image super-
resolution tasks, due to its long-range and global aggregation capability. However, the …

Vision transformers for single image dehazing

Y Song, Z He, H Qian, X Du - IEEE Transactions on Image …, 2023 - ieeexplore.ieee.org
Image dehazing is a representative low-level vision task that estimates latent haze-free
images from hazy images. In recent years, convolutional neural network-based methods …