Adaptive extreme edge computing for wearable devices

E Covi, E Donati, X Liang, D Kappel… - Frontiers in …, 2021 - frontiersin.org
Wearable devices are a fast-growing technology with impact on personal healthcare for both
society and economy. Due to the widespread of sensors in pervasive and distributed …

Pruning and quantization for deep neural network acceleration: A survey

T Liang, J Glossner, L Wang, S Shi, X Zhang - Neurocomputing, 2021 - Elsevier
Deep neural networks have been applied in many applications exhibiting extraordinary
abilities in the field of computer vision. However, complex network architectures challenge …

Binaryconnect: Training deep neural networks with binary weights during propagations

M Courbariaux, Y Bengio… - Advances in neural …, 2015 - proceedings.neurips.cc
Abstract Deep Neural Networks (DNN) have achieved state-of-the-art results in a wide range
of tasks, with the best results obtained with large training sets and large models. In the past …

Stochastic rounding: implementation, error analysis and applications

M Croci, M Fasi, NJ Higham… - Royal Society Open …, 2022 - royalsocietypublishing.org
Stochastic rounding (SR) randomly maps a real number x to one of the two nearest values in
a finite precision number system. The probability of choosing either of these two numbers is …

Backpropagation for energy-efficient neuromorphic computing

SK Esser, R Appuswamy, P Merolla… - Advances in neural …, 2015 - proceedings.neurips.cc
Solving real world problems with embedded neural networks requires both training
algorithms that achieve high performance and compatible hardware that runs in real time …

A survey on methods and theories of quantized neural networks

Y Guo - arxiv preprint arxiv:1808.04752, 2018 - arxiv.org
Deep neural networks are the state-of-the-art methods for many real-world tasks, such as
computer vision, natural language processing and speech recognition. For all its popularity …

NullHop: A flexible convolutional neural network accelerator based on sparse representations of feature maps

A Aimar, H Mostafa, E Calabrese… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Convolutional neural networks (CNNs) have become the dominant neural network
architecture for solving many state-of-the-art (SOA) visual processing tasks. Even though …

Event-driven random back-propagation: Enabling neuromorphic deep learning machines

EO Neftci, C Augustine, S Paul… - Frontiers in neuroscience, 2017 - frontiersin.org
An ongoing challenge in neuromorphic computing is to devise general and computationally
efficient models of inference and learning which are compatible with the spatial and …

Compression of deep learning models for text: A survey

M Gupta, P Agrawal - ACM Transactions on Knowledge Discovery from …, 2022 - dl.acm.org
In recent years, the fields of natural language processing (NLP) and information retrieval (IR)
have made tremendous progress thanks to deep learning models like Recurrent Neural …

Conversion of artificial recurrent neural networks to spiking neural networks for low-power neuromorphic hardware

PU Diehl, G Zarrella, A Cassidy… - 2016 IEEE …, 2016 - ieeexplore.ieee.org
In recent years the field of neuromorphic low-power systems gained significant momentum,
spurring brain-inspired hardware systems which operate on principles that are …