Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

Why should we add early exits to neural networks?

S Scardapane, M Scarpiniti, E Baccarelli… - Cognitive Computation, 2020 - Springer
Deep neural networks are generally designed as a stack of differentiable layers, in which a
prediction is obtained only after running the full stack. Recently, some contributions have …

Skipnet: Learning dynamic routing in convolutional networks

X Wang, F Yu, ZY Dou, T Darrell… - Proceedings of the …, 2018 - openaccess.thecvf.com
While deeper convolutional networks are needed to achieve maximum accuracy in visual
perception tasks, for many inputs shallower networks are sufficient. We exploit this …

Green edge AI: A contemporary survey

Y Mao, X Yu, K Huang, YJA Zhang… - Proceedings of the …, 2024 - ieeexplore.ieee.org
Artificial intelligence (AI) technologies have emerged as pivotal enablers across a multitude
of industries, including consumer electronics, healthcare, and manufacturing, largely due to …

Efficient visual recognition: A survey on recent advances and brain-inspired methodologies

Y Wu, DH Wang, XT Lu, F Yang, M Yao… - Machine Intelligence …, 2022 - Springer
Visual recognition is currently one of the most important and active research areas in
computer vision, pattern recognition, and even the general field of artificial intelligence. It …

Adaptive neural trees

R Tanno, K Arulkumaran, D Alexander… - International …, 2019 - proceedings.mlr.press
Deep neural networks and decision trees operate on largely separate paradigms; typically,
the former performs representation learning with pre-specified architectures, while the latter …

Wisdom of committees: An overlooked approach to faster and more accurate models

X Wang, D Kondratyuk, E Christiansen… - arxiv preprint arxiv …, 2020 - arxiv.org
Committee-based models (ensembles or cascades) construct models by combining existing
pre-trained ones. While ensembles and cascades are well-known techniques that were …

Learning anytime predictions in neural networks via adaptive loss balancing

H Hu, D Dey, M Hebert, JA Bagnell - … of the AAAI Conference on Artificial …, 2019 - ojs.aaai.org
This work considers the trade-off between accuracy and testtime computational cost of deep
neural networks (DNNs) via anytime predictions from auxiliary predictions. Specifically, we …

Early-exit deep neural network-a comprehensive survey

H Rahmath P, V Srivastava, K Chaurasia… - ACM Computing …, 2024 - dl.acm.org
Deep neural networks (DNNs) typically have a single exit point that makes predictions by
running the entire stack of neural layers. Since not all inputs require the same amount of …

SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers

KL Navaneet, SA Koohpayegani… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently there has been a lot of progress in reducing the computation of deep models at
inference time. These methods can reduce both the computational needs and power usage …