Revisiting random channel pruning for neural network compression

Y Li, K Adamczewski, W Li, S Gu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of
neural networks. There has been a flurry of algorithms that try to solve this practical problem …

Scalelong: Towards more stable training of diffusion model via scaling network long skip connection

Z Huang, P Zhou, S Yan, L Lin - Advances in Neural …, 2023 - proceedings.neurips.cc
In diffusion models, UNet is the most popular network backbone, since its long skip connects
(LSCs) to connect distant network blocks can aggregate long-distant information and …

Automatic network pruning via hilbert-schmidt independence criterion lasso under information bottleneck principle

S Guo, L Zhang, X Zheng, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Most existing neural network pruning methods hand-crafted their importance criteria and
structures to prune. This constructs heavy and unintended dependencies on heuristics and …

Understanding self-attention mechanism via dynamical system perspective

Z Huang, M Liang, J Qin, S Zhong… - Proceedings of the …, 2023 - openaccess.thecvf.com
The self-attention mechanism (SAM) is widely used in various fields of artificial intelligence
and has successfully boosted the performance of different models. However, current …

Random sharpness-aware minimization

Y Liu, S Mai, M Cheng, X Chen… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract Currently, Sharpness-Aware Minimization (SAM) is proposed to seek the
parameters that lie in a flat region to improve the generalization when training neural …

Adaptive filter pruning via sensitivity feedback

Y Zhang, NM Freris - IEEE Transactions on Neural Networks …, 2023 - ieeexplore.ieee.org
Filter pruning is advocated for accelerating deep neural networks without dedicated
hardware or libraries, while maintaining high prediction accuracy. Several works have cast …

A bayesian federated learning framework with online laplace approximation

L Liu, X Jiang, F Zheng, H Chen, GJ Qi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Federated learning (FL) allows multiple clients to collaboratively learn a globally shared
model through cycles of model aggregation and local model training, without the need to …

IRPruneDet: efficient infrared small target detection via wavelet structure-regularized soft channel pruning

M Zhang, H Yang, J Guo, Y Li, X Gao… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Infrared Small Target Detection (IRSTD) refers to detecting faint targets in infrared images,
which has achieved notable progress with the advent of deep learning. However, the drive …

On fast simulation of dynamical system with neural vector enhanced numerical solver

Z Huang, S Liang, H Zhang, H Yang, L Lin - Scientific reports, 2023 - nature.com
The large-scale simulation of dynamical systems is critical in numerous scientific and
engineering disciplines. However, traditional numerical solvers are limited by the choice of …

Energy-based CNN pruning for remote sensing scene classification

Y Lu, M Gong, Z Hu, W Zhao, Z Guan… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Convolutional neural networks (CNNs) have been adopted to classify the remote sensing
scene image. However, the application of these complicated networks on the satellite …