Revisiting random channel pruning for neural network compression
Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
Scalelong: Towards more stable training of diffusion model via scaling network long skip connection
In diffusion models, UNet is the most popular network backbone, since its long skip connects
(LSCs) to connect distant network blocks can aggregate long-distant information and …
(LSCs) to connect distant network blocks can aggregate long-distant information and …
Automatic network pruning via hilbert-schmidt independence criterion lasso under information bottleneck principle
Most existing neural network pruning methods hand-crafted their importance criteria and
structures to prune. This constructs heavy and unintended dependencies on heuristics and …
structures to prune. This constructs heavy and unintended dependencies on heuristics and …
Understanding self-attention mechanism via dynamical system perspective
The self-attention mechanism (SAM) is widely used in various fields of artificial intelligence
and has successfully boosted the performance of different models. However, current …
and has successfully boosted the performance of different models. However, current …
Random sharpness-aware minimization
Abstract Currently, Sharpness-Aware Minimization (SAM) is proposed to seek the
parameters that lie in a flat region to improve the generalization when training neural …
parameters that lie in a flat region to improve the generalization when training neural …
Adaptive filter pruning via sensitivity feedback
Y Zhang, NM Freris - IEEE Transactions on Neural Networks …, 2023 - ieeexplore.ieee.org
Filter pruning is advocated for accelerating deep neural networks without dedicated
hardware or libraries, while maintaining high prediction accuracy. Several works have cast …
hardware or libraries, while maintaining high prediction accuracy. Several works have cast …
A bayesian federated learning framework with online laplace approximation
Federated learning (FL) allows multiple clients to collaboratively learn a globally shared
model through cycles of model aggregation and local model training, without the need to …
model through cycles of model aggregation and local model training, without the need to …
IRPruneDet: efficient infrared small target detection via wavelet structure-regularized soft channel pruning
Infrared Small Target Detection (IRSTD) refers to detecting faint targets in infrared images,
which has achieved notable progress with the advent of deep learning. However, the drive …
which has achieved notable progress with the advent of deep learning. However, the drive …
On fast simulation of dynamical system with neural vector enhanced numerical solver
The large-scale simulation of dynamical systems is critical in numerous scientific and
engineering disciplines. However, traditional numerical solvers are limited by the choice of …
engineering disciplines. However, traditional numerical solvers are limited by the choice of …
Energy-based CNN pruning for remote sensing scene classification
Convolutional neural networks (CNNs) have been adopted to classify the remote sensing
scene image. However, the application of these complicated networks on the satellite …
scene image. However, the application of these complicated networks on the satellite …