A survey on deep neural network pruning: Taxonomy, comparison, analysis, and recommendations
Modern deep neural networks, particularly recent large language models, come with
massive model sizes that require significant computational and storage resources. To …
massive model sizes that require significant computational and storage resources. To …
A survey on efficient convolutional neural networks and hardware acceleration
Over the past decade, deep-learning-based representations have demonstrated remarkable
performance in academia and industry. The learning capability of convolutional neural …
performance in academia and industry. The learning capability of convolutional neural …
Depgraph: Towards any structural pruning
Structural pruning enables model acceleration by removing structurally-grouped parameters
from neural networks. However, the parameter-grou** patterns vary widely across …
from neural networks. However, the parameter-grou** patterns vary widely across …
Structured pruning for deep convolutional neural networks: A survey
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …
attributed to their deeper and wider architectures, which can come with significant …
Revisiting random channel pruning for neural network compression
Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
neural networks. There has been a flurry of algorithms that try to solve this practical problem …
Convolutional neural network pruning with structural redundancy reduction
Z Wang, C Li, X Wang - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Convolutional neural network (CNN) pruning has become one of the most successful
network compression approaches in recent years. Existing works on network pruning …
network compression approaches in recent years. Existing works on network pruning …
Chip: Channel independence-based pruning for compact neural networks
Filter pruning has been widely used for neural network compression because of its enabled
practical acceleration. To date, most of the existing filter pruning works explore the …
practical acceleration. To date, most of the existing filter pruning works explore the …
Local relation learning for face forgery detection
With the rapid development of facial manipulation techniques, face forgery has received
considerable attention in digital media forensics due to security concerns. Most existing …
considerable attention in digital media forensics due to security concerns. Most existing …
Group fisher pruning for practical network compression
Network compression has been widely studied since it is able to reduce the memory and
computation cost during inference. However, previous methods seldom deal with …
computation cost during inference. However, previous methods seldom deal with …
Eagleeye: Fast sub-net evaluation for efficient neural network pruning
Finding out the computational redundant part of a trained Deep Neural Network (DNN) is the
key question that pruning algorithms target on. Many algorithms try to predict model …
key question that pruning algorithms target on. Many algorithms try to predict model …