Lightweight deep learning for resource-constrained environments: A survey

HI Liu, M Galindo, H **e, LK Wong, HH Shuai… - ACM Computing …, 2024 - dl.acm.org
Over the past decade, the dominance of deep learning has prevailed across various
domains of artificial intelligence, including natural language processing, computer vision …

A survey of techniques for optimizing transformer inference

KT Chitty-Venkata, S Mittal, M Emani… - Journal of Systems …, 2023 - Elsevier
Recent years have seen a phenomenal rise in the performance and applications of
transformer neural networks. The family of transformer networks, including Bidirectional …

Rewrite the stars

X Ma, X Dai, Y Bai, Y Wang… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Recent studies have drawn attention to the untapped potential of the" star
operation"(element-wise multiplication) in network design. While intuitive explanations …

Topformer: Token pyramid transformer for mobile semantic segmentation

W Zhang, Z Huang, G Luo, T Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
Although vision transformers (ViTs) have achieved great success in computer vision, the
heavy computational cost hampers their applications to dense prediction tasks such as …

Mobile-former: Bridging mobilenet and transformer

Y Chen, X Dai, D Chen, M Liu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Mobile-Former, a parallel design of MobileNet and transformer with a
two-way bridge in between. This structure leverages the advantages of MobileNet at local …

Pruning and quantization for deep neural network acceleration: A survey

T Liang, J Glossner, L Wang, S Shi, X Zhang - Neurocomputing, 2021 - Elsevier
Deep neural networks have been applied in many applications exhibiting extraordinary
abilities in the field of computer vision. However, complex network architectures challenge …

Differentiable spike: Rethinking gradient-descent for training spiking neural networks

Y Li, Y Guo, S Zhang, S Deng… - Advances in neural …, 2021 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) have emerged as a biology-inspired method
mimicking the spiking nature of brain neurons. This bio-mimicry derives SNNs' energy …

COVID-19 detection through transfer learning using multimodal imaging data

MJ Horry, S Chakraborty, M Paul, A Ulhaq… - Ieee …, 2020 - ieeexplore.ieee.org
Detecting COVID-19 early may help in devising an appropriate treatment plan and disease
containment decisions. In this study, we demonstrate how transfer learning from deep …

[HTML][HTML] A review of image super-resolution approaches based on deep learning and applications in remote sensing

X Wang, J Yi, J Guo, Y Song, J Lyu, J Xu, W Yan… - Remote Sensing, 2022 - mdpi.com
At present, with the advance of satellite image processing technology, remote sensing
images are becoming more widely used in real scenes. However, due to the limitations of …

Deep spoken keyword spotting: An overview

I López-Espejo, ZH Tan, JHL Hansen, J Jensen - IEEE Access, 2021 - ieeexplore.ieee.org
Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams
and has become a fast-growing technology thanks to the paradigm shift introduced by deep …