A review of convolutional neural network architectures and their optimizations

S Cong, Y Zhou - Artificial Intelligence Review, 2023 - Springer
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …

Recent advances in convolutional neural network acceleration

Q Zhang, M Zhang, T Chen, Z Sun, Y Ma, B Yu - Neurocomputing, 2019 - Elsevier
In recent years, convolutional neural networks (CNNs) have shown great performance in
various fields such as image classification, pattern recognition, and multi-media …

What is the state of neural network pruning?

D Blalock, JJ Gonzalez Ortiz… - … of machine learning …, 2020 - proceedings.mlsys.org
Neural network pruning---the task of reducing the size of a network by removing parameters--
-has been the subject of a great deal of work in recent years. We provide a meta-analysis of …

Edge intelligence: Empowering intelligence to the edge of network

D Xu, T Li, Y Li, X Su, S Tarkoma, T Jiang… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Edge intelligence refers to a set of connected systems and devices for data collection,
caching, processing, and analysis proximity to where data are captured based on artificial …

Towards accurate post-training network quantization via bit-split and stitching

P Wang, Q Chen, X He… - … Conference on Machine …, 2020 - proceedings.mlr.press
Network quantization is essential for deploying deep models to IoT devices due to its high
efficiency. Most existing quantization approaches rely on the full training datasets and the …

Recent advances in efficient computation of deep convolutional neural networks

J Cheng, P Wang, G Li, Q Hu, H Lu - Frontiers of Information Technology & …, 2018 - Springer
Deep neural networks have evolved remarkably over the past few years and they are
currently the fundamental tools of many intelligent systems. At the same time, the …

Edge intelligence: Architectures, challenges, and applications

D Xu, T Li, Y Li, X Su, S Tarkoma, T Jiang… - arxiv preprint arxiv …, 2020 - arxiv.org
Edge intelligence refers to a set of connected systems and devices for data collection,
caching, processing, and analysis in locations close to where data is captured based on …

Shallowing deep networks: Layer-wise pruning based on feature representations

S Chen, Q Zhao - IEEE transactions on pattern analysis and …, 2018 - ieeexplore.ieee.org
Recent surge of Convolutional Neural Networks (CNNs) has brought successes among
various applications. However, these successes are accompanied by a significant increase …

Two-step quantization for low-bit neural networks

P Wang, Q Hu, Y Zhang, C Zhang… - Proceedings of the …, 2018 - openaccess.thecvf.com
Every bit matters in the hardware design of quantized neural networks. However, extremely-
low-bit representation usually causes large accuracy drop. Thus, how to train extremely-low …

Coordinating filters for faster deep neural networks

W Wen, C Xu, C Wu, Y Wang… - Proceedings of the …, 2017 - openaccess.thecvf.com
Abstract Very large-scale Deep Neural Networks (DNNs) have achieved remarkable
successes in a large variety of computer vision tasks. However, the high computation …