A survey on deep neural network pruning: Taxonomy, comparison, analysis, and recommendations

H Cheng, M Zhang, JQ Shi - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
Modern deep neural networks, particularly recent large language models, come with
massive model sizes that require significant computational and storage resources. To …

Towards edge computing in intelligent manufacturing: Past, present and future

G Nain, KK Pattanaik, GK Sharma - Journal of Manufacturing Systems, 2022 - Elsevier
Abstract Industry 4.0 (I4. 0) is the fourth industrial revolution and a synonym for intelligent
manufacturing. It drives the convergence of several cutting-edge technologies to provoke …

Semi-supervised semantic segmentation using unreliable pseudo-labels

Y Wang, H Wang, Y Shen, J Fei, W Li… - Proceedings of the …, 2022 - openaccess.thecvf.com
The crux of semi-supervised semantic segmentation is to assign pseudo-labels to the pixels
of unlabeled images. A common practice is to select the highly confident predictions as the …

Efficient on-device session-based recommendation

X **a, J Yu, Q Wang, C Yang, NQV Hung… - ACM Transactions on …, 2023 - dl.acm.org
On-device session-based recommendation systems have been achieving increasing
attention on account of the low energy/resource consumption and privacy protection while …

Hierarchical representation and interpretable learning for accelerated quality monitoring in machining process

D Hoang, H Errahmouni, H Chen, S Rachuri… - CIRP Journal of …, 2024 - Elsevier
While modern 5-axis computer numerical control (CNC) systems offer enhanced design
flexibility and reduced production time, the dimensional accuracy of the workpiece is …

[PDF][PDF] Deep neural networks optimization for resource-constrained environments: techniques and models

R Careem, G Johar, A Khatibi - Indonesian Journal of Electrical …, 2024 - researchgate.net
This paper aims to present a comprehensive review of advanced techniques and models
with a specific focus on deep neural network (DNN) for resource-constrained environments …

Enhanced sparsification via stimulative training

S Tang, W Lin, H Ye, P Ye, C Yu, B Li… - European Conference on …, 2024 - Springer
Sparsification-based pruning has been an important category in model compression.
Existing methods commonly set sparsity-inducing penalty terms to suppress the importance …

A novel small-sample dense teacher assistant knowledge distillation method for bearing fault diagnosis

H Zhong, S Yu, H Trinh, Y Lv, R Yuan… - IEEE Sensors …, 2023 - ieeexplore.ieee.org
Recently, deep learning models have been widely studied and applied in fault diagnosis.
However, two common drawbacks are: 1) they usually require a large amount of storage …

Expanding and refining hybrid compressors for efficient object re-identification

Y **e, H Wu, J Zhu, H Zeng… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recent object re-identification (Re-ID) methods gain high efficiency via lightweight student
models trained by knowledge distillation (KD). However, the huge architectural difference …

A hybrid framework leveraging whale optimization and deep learning with trust-index for attack identification in IoT networks

V Gotarane, S Abimannan, S Hussain… - IEEE Access, 2024 - ieeexplore.ieee.org
The rise of smart cities, smart homes, and smart health powered by the Internet of Things
(IoT) presents significant challenges in design, deployment, and security. The seamless data …