A survey on evolutionary neural architecture search

Y Liu, Y Sun, B Xue, M Zhang, GG Yen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …

[HTML][HTML] A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks

MAK Raiaan, S Sakib, NM Fahad, A Al Mamun… - Decision analytics …, 2024 - Elsevier
Abstract Convolutional Neural Network (CNN) is a prevalent topic in deep learning (DL)
research for their architectural advantages. CNN relies heavily on hyperparameter …

Evolutionary deep learning: A survey

ZH Zhan, JY Li, J Zhang - Neurocomputing, 2022 - Elsevier
As an advanced artificial intelligence technique for solving learning problems, deep learning
(DL) has achieved great success in many real-world applications and attracted increasing …

Survey on evolutionary deep learning: Principles, algorithms, applications, and open issues

N Li, L Ma, G Yu, B Xue, M Zhang, Y ** - ACM Computing Surveys, 2023 - dl.acm.org
Over recent years, there has been a rapid development of deep learning (DL) in both
industry and academia fields. However, finding the optimal hyperparameters of a DL model …

Particle swarm optimization of deep neural networks architectures for image classification

FEF Junior, GG Yen - Swarm and Evolutionary Computation, 2019 - Elsevier
Deep neural networks have been shown to outperform classical machine learning
algorithms in solving real-world problems. However, the most successful deep neural …

Neural architecture search based on a multi-objective evolutionary algorithm with probability stack

Y Xue, C Chen, A Słowik - IEEE Transactions on Evolutionary …, 2023 - ieeexplore.ieee.org
With the emergence of deep neural networks, many research fields, such as image
classification, object detection, speech recognition, natural language processing, machine …

Delving deep into spatial pooling for squeeze-and-excitation networks

X **, Y **e, XS Wei, BR Zhao, ZM Chen, X Tan - Pattern Recognition, 2022 - Elsevier
Abstract Squeeze-and-Excitation (SE) blocks have demonstrated significant accuracy gains
for state-of-the-art deep architectures by re-weighting channel-wise feature responses. The …

A comprehensive survey on optimizing deep learning models by metaheuristics

B Akay, D Karaboga, R Akay - Artificial Intelligence Review, 2022 - Springer
Deep neural networks (DNNs), which are extensions of artificial neural networks, can learn
higher levels of feature hierarchy established by lower level features by transforming the raw …

Eight years of AutoML: categorisation, review and trends

R Barbudo, S Ventura, JR Romero - Knowledge and Information Systems, 2023 - Springer
Abstract Knowledge extraction through machine learning techniques has been successfully
applied in a large number of application domains. However, apart from the required …

A survey of swarm and evolutionary computing approaches for deep learning

A Darwish, AE Hassanien, S Das - Artificial intelligence review, 2020 - Springer
Deep learning (DL) has become an important machine learning approach that has been
widely successful in many applications. Currently, DL is one of the best methods of …