Structured pruning for deep convolutional neural networks: A survey

Y He, L **
G Yang, S Yu, H Yang, Z Nie, J Wang - Plos one, 2023 - journals.plos.org
Previous studies have shown that deep models are often over-parameterized, and this
parameter redundancy makes deep compression possible. The redundancy of model weight …

A priori compression of convolutional neural networks for wave simulators

H Boukraichi, N Akkari, F Casenave… - … Applications of Artificial …, 2023 - Elsevier
Convolutional neural networks are now seeing widespread use in a variety of fields,
including image classification, facial and object recognition, medical imaging analysis, and …

Remote sensing imagery object detection model compression via tucker decomposition

L Huyan, Y Li, D Jiang, Y Zhang, Q Zhou, B Li, J Wei… - Mathematics, 2023 - mdpi.com
Although convolutional neural networks (CNNs) have made significant progress, their
deployment onboard is still challenging because of their complexity and high processing …

Building variable-sized models via learngene pool

B Shi, S **a, X Yang, H Chen, Z Kou… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Abstract Recently, Stitchable Neural Networks (SN-Net) is proposed to stitch some pre-
trained networks for quickly building numerous networks with different complexity and …

Low rank optimization for efficient deep learning: Making a balance between compact architecture and fast training

X Ou, Z Chen, C Zhu, Y Liu - Journal of Systems Engineering …, 2023 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many data processing
applications. However, high computational complexity and storage cost make deep learning …

Attention and feature transfer based knowledge distillation

G Yang, S Yu, Y Sheng, H Yang - Scientific Reports, 2023 - nature.com
Existing knowledge distillation (KD) methods are mainly based on features, logic, or
attention, where features and logic represent the results of reasoning at different stages of a …

Generalized kronecker-based adapters for parameter-efficient fine-tuning of vision transformers

A Edalati, MGA Hameed… - 2023 20th Conference on …, 2023 - ieeexplore.ieee.org
While large transformer-based vision models have achieved remarkable performance on a
variety of Computer Vision (CV) applications, they are cumbersome to fine-tune for target …

HyperMetric: Robust hyperdimensional computing on error-prone memories using metric learning

W Xu, V Swaminathan, S **e… - 2023 IEEE 41st …, 2023 - ieeexplore.ieee.org
Hyperdimensional computing (HDC) is emerging as an efficient and robust computing
paradigm that has strong resilience to various types of errors. The robustness of HDC makes …