What is the state of neural network pruning?
D Blalock, JJ Gonzalez Ortiz… - … of machine learning …, 2020 - proceedings.mlsys.org
Neural network pruning---the task of reducing the size of a network by removing parameters--
-has been the subject of a great deal of work in recent years. We provide a meta-analysis of …
-has been the subject of a great deal of work in recent years. We provide a meta-analysis of …
Snip: Single-shot network pruning based on connection sensitivity
Pruning large neural networks while maintaining their performance is often desirable due to
the reduced space and time complexity. In existing methods, pruning is done within an …
the reduced space and time complexity. In existing methods, pruning is done within an …
Towards optimal structured cnn pruning via generative adversarial learning
Structured pruning of filters or neurons has received increased focus for compressing
convolutional neural networks. Most existing methods rely on multi-stage optimizations in a …
convolutional neural networks. Most existing methods rely on multi-stage optimizations in a …
Learning efficient convolutional networks through network slimming
The deployment of deep convolutional neural networks (CNNs) in many real world
applications is largely hindered by their high computational cost. In this paper, we propose a …
applications is largely hindered by their high computational cost. In this paper, we propose a …
Pruning filters for efficient convnets
The success of CNNs in various applications is accompanied by a significant increase in the
computation and parameter storage costs. Recent efforts toward reducing these overheads …
computation and parameter storage costs. Recent efforts toward reducing these overheads …
GhostNets on heterogeneous devices via cheap operations
Deploying convolutional neural networks (CNNs) on mobile devices is difficult due to the
limited memory and computation resources. We aim to design efficient neural networks for …
limited memory and computation resources. We aim to design efficient neural networks for …
Parametric exponential linear unit for deep convolutional neural networks
Object recognition is an important task for improving the ability of visual systems to perform
complex scene understanding. Recently, the Exponential Linear Unit (ELU) has been …
complex scene understanding. Recently, the Exponential Linear Unit (ELU) has been …
Defeating image obfuscation with deep learning
We demonstrate that modern image recognition methods based on artificial neural networks
can recover hidden information from images protected by various forms of obfuscation. The …
can recover hidden information from images protected by various forms of obfuscation. The …
Scaling the scattering transform: Deep hybrid networks
We use the scattering network as a generic and fixed initialization of the first layers of a
supervised hybrid deep network. We show that early layers do not necessarily need to be …
supervised hybrid deep network. We show that early layers do not necessarily need to be …
Understanding adversarial training: Increasing local stability of neural nets through robust optimization
We propose a general framework for increasing local stability of Artificial Neural Nets
(ANNs) using Robust Optimization (RO). We achieve this through an alternating …
(ANNs) using Robust Optimization (RO). We achieve this through an alternating …