A comprehensive review of binary neural network

C Yuan, SS Agaian - Artificial Intelligence Review, 2023 - Springer
Deep learning (DL) has recently changed the development of intelligent systems and is
widely adopted in many real-life applications. Despite their various benefits and potentials …

A systematic literature review on binary neural networks

R Sayed, H Azmi, H Shawkey, AH Khalil… - IEEE Access, 2023 - ieeexplore.ieee.org
This paper presents an extensive literature review on Binary Neural Network (BNN). BNN
utilizes binary weights and activation function parameters to substitute the full-precision …

Towards accurate post-training network quantization via bit-split and stitching

P Wang, Q Chen, X He… - … Conference on Machine …, 2020 - proceedings.mlr.press
Network quantization is essential for deploying deep models to IoT devices due to its high
efficiency. Most existing quantization approaches rely on the full training datasets and the …

Adabin: Improving binary neural networks with adaptive binary sets

Z Tu, X Chen, P Ren, Y Wang - European conference on computer vision, 2022 - Springer
This paper studies the Binary Neural Networks (BNNs) in which weights and activations are
both binarized into 1-bit values, thus greatly reducing the memory usage and computational …

Bibench: Benchmarking and analyzing network binarization

H Qin, M Zhang, Y Ding, A Li, Z Cai… - International …, 2023 - proceedings.mlr.press
Network binarization emerges as one of the most promising compression approaches
offering extraordinary computation and memory savings by minimizing the bit-width …

Towards ultra low latency spiking neural networks for vision and sequential tasks using temporal pruning

SS Chowdhury, N Rathi, K Roy - European Conference on Computer …, 2022 - Springer
Abstract Spiking Neural Networks (SNNs) can be energy efficient alternatives to commonly
used deep neural networks (DNNs). However, computation over multiple timesteps …

Distribution-sensitive information retention for accurate binary neural network

H Qin, X Zhang, R Gong, Y Ding, Y Xu, X Liu - International Journal of …, 2023 - Springer
Abstract Model binarization is an effective method of compressing neural networks and
accelerating their inference process, which enables state-of-the-art models to run on …

Lightweight pixel difference networks for efficient visual representation learning

Z Su, J Zhang, L Wang, H Zhang, Z Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Recently, there have been tremendous efforts in develo** lightweight Deep Neural
Networks (DNNs) with satisfactory accuracy, which can enable the ubiquitous deployment of …

Improving accuracy of binary neural networks using unbalanced activation distribution

H Kim, J Park, C Lee, JJ Kim - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Binarization of neural network models is considered as one of the promising methods to
deploy deep neural network models on resource-constrained environments such as mobile …

Improving extreme low-bit quantization with soft threshold

W Xu, F Li, Y Jiang, A Yong, X He… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Deep neural networks executing with low precision at inference time can gain acceleration
and compression advantages over their high-precision counterparts, but need to overcome …