What is the state of neural network pruning?

D Blalock, JJ Gonzalez Ortiz… - … of machine learning …, 2020 - proceedings.mlsys.org
Neural network pruning---the task of reducing the size of a network by removing parameters--
-has been the subject of a great deal of work in recent years. We provide a meta-analysis of …

Snip: Single-shot network pruning based on connection sensitivity

N Lee, T Ajanthan, PHS Torr - arxiv preprint arxiv:1810.02340, 2018 - arxiv.org
Pruning large neural networks while maintaining their performance is often desirable due to
the reduced space and time complexity. In existing methods, pruning is done within an …

Towards optimal structured cnn pruning via generative adversarial learning

S Lin, R Ji, C Yan, B Zhang, L Cao… - Proceedings of the …, 2019 - openaccess.thecvf.com
Structured pruning of filters or neurons has received increased focus for compressing
convolutional neural networks. Most existing methods rely on multi-stage optimizations in a …

Learning efficient convolutional networks through network slimming

Z Liu, J Li, Z Shen, G Huang, S Yan… - Proceedings of the …, 2017 - openaccess.thecvf.com
The deployment of deep convolutional neural networks (CNNs) in many real world
applications is largely hindered by their high computational cost. In this paper, we propose a …

Pruning filters for efficient convnets

H Li, A Kadav, I Durdanovic, H Samet… - arxiv preprint arxiv …, 2016 - arxiv.org
The success of CNNs in various applications is accompanied by a significant increase in the
computation and parameter storage costs. Recent efforts toward reducing these overheads …

GhostNets on heterogeneous devices via cheap operations

K Han, Y Wang, C Xu, J Guo, C Xu, E Wu… - International Journal of …, 2022 - Springer
Deploying convolutional neural networks (CNNs) on mobile devices is difficult due to the
limited memory and computation resources. We aim to design efficient neural networks for …

Parametric exponential linear unit for deep convolutional neural networks

L Trottier, P Giguere… - 2017 16th IEEE …, 2017 - ieeexplore.ieee.org
Object recognition is an important task for improving the ability of visual systems to perform
complex scene understanding. Recently, the Exponential Linear Unit (ELU) has been …

Defeating image obfuscation with deep learning

R McPherson, R Shokri, V Shmatikov - arxiv preprint arxiv:1609.00408, 2016 - arxiv.org
We demonstrate that modern image recognition methods based on artificial neural networks
can recover hidden information from images protected by various forms of obfuscation. The …

Scaling the scattering transform: Deep hybrid networks

E Oyallon, E Belilovsky… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
We use the scattering network as a generic and fixed initialization of the first layers of a
supervised hybrid deep network. We show that early layers do not necessarily need to be …

Understanding adversarial training: Increasing local stability of neural nets through robust optimization

U Shaham, Y Yamada, S Negahban - arxiv preprint arxiv:1511.05432, 2015 - arxiv.org
We propose a general framework for increasing local stability of Artificial Neural Nets
(ANNs) using Robust Optimization (RO). We achieve this through an alternating …