Dynamic neural networks: A survey
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …
models which have fixed computational graphs and parameters at the inference stage …
Why should we add early exits to neural networks?
Deep neural networks are generally designed as a stack of differentiable layers, in which a
prediction is obtained only after running the full stack. Recently, some contributions have …
prediction is obtained only after running the full stack. Recently, some contributions have …
Skipnet: Learning dynamic routing in convolutional networks
While deeper convolutional networks are needed to achieve maximum accuracy in visual
perception tasks, for many inputs shallower networks are sufficient. We exploit this …
perception tasks, for many inputs shallower networks are sufficient. We exploit this …
Green edge AI: A contemporary survey
Artificial intelligence (AI) technologies have emerged as pivotal enablers across a multitude
of industries, including consumer electronics, healthcare, and manufacturing, largely due to …
of industries, including consumer electronics, healthcare, and manufacturing, largely due to …
Efficient visual recognition: A survey on recent advances and brain-inspired methodologies
Visual recognition is currently one of the most important and active research areas in
computer vision, pattern recognition, and even the general field of artificial intelligence. It …
computer vision, pattern recognition, and even the general field of artificial intelligence. It …
Adaptive neural trees
Deep neural networks and decision trees operate on largely separate paradigms; typically,
the former performs representation learning with pre-specified architectures, while the latter …
the former performs representation learning with pre-specified architectures, while the latter …
Wisdom of committees: An overlooked approach to faster and more accurate models
Committee-based models (ensembles or cascades) construct models by combining existing
pre-trained ones. While ensembles and cascades are well-known techniques that were …
pre-trained ones. While ensembles and cascades are well-known techniques that were …
Learning anytime predictions in neural networks via adaptive loss balancing
This work considers the trade-off between accuracy and testtime computational cost of deep
neural networks (DNNs) via anytime predictions from auxiliary predictions. Specifically, we …
neural networks (DNNs) via anytime predictions from auxiliary predictions. Specifically, we …
Early-exit deep neural network-a comprehensive survey
Deep neural networks (DNNs) typically have a single exit point that makes predictions by
running the entire stack of neural layers. Since not all inputs require the same amount of …
running the entire stack of neural layers. Since not all inputs require the same amount of …
SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers
Recently there has been a lot of progress in reducing the computation of deep models at
inference time. These methods can reduce both the computational needs and power usage …
inference time. These methods can reduce both the computational needs and power usage …