Adapting neural networks at runtime: Current trends in at-runtime optimizations for deep learning

M Sponner, B Waschneck, A Kumar - ACM Computing Surveys, 2024 - dl.acm.org
Adaptive optimization methods for deep learning adjust the inference task to the current
circumstances at runtime to improve the resource footprint while maintaining the model's …

Efficientvit: Memory efficient vision transformer with cascaded group attention

X Liu, H Peng, N Zheng, Y Yang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Vision transformers have shown great success due to their high model capabilities.
However, their remarkable performance is accompanied by heavy computation costs, which …

ZeroNAS: Differentiable generative adversarial networks search for zero-shot learning

C Yan, X Chang, Z Li, W Guan, Z Ge… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
In recent years, remarkable progress in zero-shot learning (ZSL) has been achieved by
generative adversarial networks (GAN). To compensate for the lack of training samples in …

Adanic: Towards practical neural image compression via dynamic transform routing

L Tao, W Gao, G Li, C Zhang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Compressive autoencoders (CAEs) play an important role in deep learning-based image
compression, but large-scale CAEs are computationally expensive. We propose a …

Adversarial attack mitigation strategy for machine learning-based network attack detection model in power system

R Huang, Y Li - IEEE Transactions on Smart Grid, 2022 - ieeexplore.ieee.org
The network attack detection model based on machine learning (ML) has received extensive
attention and research in PMU measurement data protection of power systems. However …

Single-domain generalized predictor for neural architecture search system

L Ma, H Kang, G Yu, Q Li, Q He - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Performance predictors are used to reduce architecture evaluation costs in neural
architecture search, which however suffers from a large amount of budget consumption in …

Adafocus v2: End-to-end training of spatial dynamic networks for video recognition

Y Wang, Y Yue, Y Lin, H Jiang, Z Lai… - 2022 IEEE/CVF …, 2022 - ieeexplore.ieee.org
Recent works have shown that the computational efficiency of video recognition can be
significantly improved by reducing the spatial redundancy. As a representative work, the …

Automated progressive learning for efficient training of vision transformers

C Li, B Zhuang, G Wang, X Liang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Recent advances in vision Transformers (ViTs) have come with a voracious appetite for
computing power, high-lighting the urgent need to develop efficient training methods for …

Dss-net: Dynamic self-supervised network for video anomaly detection

P Wu, W Wang, F Chang, C Liu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Video Anomaly detection, aiming to detect the abnormal behaviors in surveillance videos, is
a challenging task since the anomalous events are diversified and complicated in different …

Beyond fixation: Dynamic window visual transformer

P Ren, C Li, G Wang, Y **ao, Q Du… - Proceedings of the …, 2022 - openaccess.thecvf.com
Recently, a surge of interest in visual transformers is to reduce the computational cost by
limiting the calculation of self-attention to a local window. Most current work uses a fixed …